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ABSTRACT 

' 'A 

The  assumption  made  in  linear  programming  that  the  components 
are  deterministic  (constant)  numbers  is  rarely  fulfilled  in  prac- 
tical applications.  This  has  led  to  the  development  of  the  field 
of  stochastic  programming  where  the  random  aspect  of  the  coeffi- 
cients in  the  objective  function,  technology  matrix,  and  the 
vector  of  resources  are  taken  into  account.  -ift  this  research 
investigate^the  problem  of  a linear  program  with  uncertainty 
attached  to  the  decision  vector.  For  example,  a decision  to 
order  a certain  amount  of  a perishable  good  might  yield  variable 
amounts  of  this  good  at  delivery  due  to  spoilage. 

Two  models  are  considered: 

1.  The  uncertainty  is  independent  of  the  decision.  A 
decision  x will  yield  an  output  x + e where  e 
is  a random  variable. 

2.  The  uncertainty  is  proportional  to  the  decision. 

A decision  x will  yield  an  output  x + ax  where 
a is  a random  variable. 

As  can  be  seen  in  the  literature  on  stochastic  programming,  the 
random  nature  of  the  program  does  not  lead  to  a unique  mathe- 
matical problem  and  there  are  various  models  of  stochastic 
linear  programs.  In  this  study  we  chose  to  use  the  chance- 
constrained  approach  to  formulate  two  models  incorporating  the 
two  kinds  of  decision  uncertainties  described  above.  In  chance- 
constrained  programs  the  criterion  is  the  expected  value  of  the 


objective  function  and  the  constraints  have  to  be  satisfied  with- 
in a predetermined  fixed  probability. 


Using  known  methods  of  chance-constrained  programming  we 
define  deterministic  equivalent  problems  for  our  two  stochastic 
models.  It  is  assumed  that  the  distributions  of  the  random  vari- 
ables are  known  and  convolutions  of  these  distributions  can  easily 
ij  be  obtained.  In  general  this  is  not  the  case,  this  is  why  we  then 

proceed  to  find  conservative  approximations  for  our  two  models 
(i.e.,  problems  with  the  same  objective  functions  whose  feasibil- 
ity sets  are  subsets  of  the  original  feasibility  sets) . We  pre- 
sent a set  of  random  variables  for  which  conservative  approxima- 
tions are  easily  obtainable  linear  programs.  Bounds  oh  the 
optimal  value  of  the  objective  function  are  also  defined.  Using 
these  results,  different  kinds  of  sensitivity  analyses  are  in- 
vestigated. In  this  context  a problem  of  trade-off  between  the 
cost  of  reducing  the  variance  of  the  uncertainties  versus  the 
corresponding  improvement  in  the  objective  function  is  defined 
and  a simple  algorithm  is  presented  to  solve  this  problem. 

Finally,  we  outline  how  some  of  the  results  can  be  applied 
to  more  general  chance-constrained  programs  and  conservative 
approximations  can  be  defined  for  these  more  general  models. 
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INTRODUCTION 


Stochastic  Linear  Programming  is  the  field  of  study  of  linear 
programming  problems,  where  the  random  aspect  of  the  coefficients 
in  the  objective  function,  technology  matrix,  and  the  vector  of 
resources  are  taken  into  account.  More  than  one  approach  has  been 
developed  in  this  context  such  as  the  distribution  problem  [13]  and 
multistage  Recourse  Models  [13].  In  this  research  we  will  restrict 
our  study  to  the  chance-constrained  approach,  a method  originally 
introduced  by  Charnes  and  Cooper  [3].  Chance-constrained  programming 
allows  constraint  violations  up  to  specified  probability  limits.  This 
study  differs  from  the  usual  chance-constrained  problem  in  that  the 
randomness  in  the  decision  vectors  is  studied  rather  than  the  coeffi- 
cients of  the  objective  function,  technology  matrix,  and  vector  of 
resources.  For  example,  a decision  to  order  a certain  amount  of  a 
perishable  good  might  yield  variable  amounts  of  this  good  at  delivery 
due  to  spoilage.  Another  example  is  the  uncertainty  due  to  measuring 
errors.  These  are  the  types  of  uncertainty  that  we  are  trying  to 
incorporate  into  a linear  program. 

In  Chapter  I we  present  two  basic  models  which  will  be  analyzed 
throughout  this  study.  In  Model  I,  the  uncertainty  is  independent  of 
the  decision.  A decision  x will  yield  an  output  x + e where  e 
is  a random  variable.  In  Model  II,  the  uncertainty  is  proportional  to 
the  decision.  A decision  x will  yield  an  output  x + ax  where  a 
is  a random  variable.  Using  the  approach  developed  by  Charnes  and 
Cooper  [4],  deterministics  equivalents  for  Models  I and  II  are  pre- 
sented and  discussed.  Because  of  the  difficulty  of  implementing  in 
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practice  these  deterministic  equivalents,  we  looked  for  a class  of 
distributions  for  which  approximations  could  be  determined  with 
little  effort.  To  this  effect,  in  Chapter  II  a class  of  densities 
and  the  corresponding  set  of  random  variables  and  their  properties 
are  presented.  In  Chapter  III,  the  results  of  Chapter  II  are  exploited 
to  find  "conservative  approximations"  to  Models  I and  II  under  certain 
assumptions.  By  "conservative  approximation"  we  mean  a problem  with  the 
same  objective  function  as  the  original  problem  and  a feasibility  set 
which  is  a subset  of  the  original  feasibility  set.  In  Chapter  IV, 
sensitivity  analysis  of  Models  I and  II  are  discussed  with  respect 
to  the  cost  vector,  the  vector  of  resources,  the  specified  probability 
limits,  and  variations  in  the  densities  of  the  random  variables. 

Finally,  the  "reducing  of  uncertainty"  problem  is  presented.  It  is  a 
problem  of  trade-off  between  the  cost  of  decreasing  the  uncertainty  by 
modifying  the  densities  of  the  random  variables  versus  the  original 
linear  objective  function. 

In  Chapter  V an  algorithm  is  presented  for  solving  a special 
kind  of  reducing  of  uncertainty  problem  which  has  the  following  general 
formulation. 

T 1 

minimize  c x + — — (with  d > 0) 

dy 

subject  to  Ax  - By  b 
x >_  0 
1 > y > 0 

where  A , 3 , b , c , d are  given,  A and  B are  m * n matrices, 
c and  d are  n * 1 vectors  and  b is  an  m x 1 vector,  x and  y 

I 


are  n * 1 vectors  of  decisions. 

Finally  in  Chapter  VI,  the  basic  two  models  are  generalized  to 
joint-chance  constraint  models  as  developed  in  Miller  and  Wagner  [10]. 
The  problems  here  are  different  from  the  usual  joint-chance  constrained 
programming  in  that  the  constraints  are  not  statistically  independent 
as  is  usually  assumed.  This  is  why  we  use  the  concept  of  associativity 
of  random  variables,  widely  used  in  the  field  of  reliability  [2],  and 
the  results  of  Chapter  II  to  define  conservative  approximations  for 
these  generalized  models. 


4 


I 


CHAPTER  I 


A.  Introduction 


This  research  is  concerned  with  a special  kind  of  stochastic 
program.  We  are  interested  in  the  usual  linear  program  with  one 
important  added  feature.  The  decisions  have  uncertainty  attached 
to  them.  For  example,  a decision  to  order  a certain  amount  of  a 
perishable  good  might  in  reality  yield  variable  amounts  at  delivery. 
Another  example  is  the  uncertainty  due  to  errors  of  the  measuring 
instruments.  It  is  this  type  of  uncertainty  that  we  are  trying  to 
incorporate  in  a regular  linear  program.  Of  course  the  stochastic 
nature  of  the  uncertainties  changes  the  character  of  the  problem. 

In  this  research  we  will  use  a chance  constrained  approach  to  the 
problem.  The  linear  constraints  are  to  be  satisfied  within  a certain 
specified  probability.  The  objective  function  will  be  the  usual 
expected  value  criterion.  Two  models  will  be  presented. 

3.  Model  I 


First  we  will  look  at  the  following  approach.  Each  variable  x^ 
has  an  uncertainty  attached  to  it  in  the  form  of  the  random  variable 
e.  . The  a priori  decision  is  x.  and  the  outcome  is  x.  + e.  . 

This  model  fits  well  in  the  context  of  measurement  errors.  Within 
certain  bounds  the  error  of  measurement  is  a function  of  the  measuring 
instrument,  not  the  quantity  measured  and  therefore  the  error  e^.  and 
the  quantity  x^  are  independent.  This  yields  the  following  model: 
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Model  Is 


minimize 


EjjL  vwj 


subject  to  x e ft 


Prob  | I Aij  ^xj  + ej  ^ 1 bi|  i 1 - 1 , ....  m 


where  A , b , c , y are  given,  A is  an  m * n matrix,  c 
an  n x 1 vector,  b and  y are  m x 1 vectors  with  the  follow- 
ing restriction  on  y : 0 <_  y^  <_  1 for  i » 1,  ...,  m ; x is 
an  n x i vector  of  decisions  and  e is  an  n x l vector  of 
random  variables.  0 is  a polyhedral  set  defined  by  a set  of 
linear  constraints. 


C.  Model  II 


Although  in  Model  I the  uncertainty  e^  is  independent  of 


the  decision  x^  , this  might  not  always  be  a desirable  feature. 


This  is  why  we  introduce  a second  model.  Here  the  uncertainty  is 


proportional  to  the  decision.  For  an  a priori  decision  x^  we 


have  an  outcome  x.  + a.x.  where  a.  is  a random  variable, 
j J j J 


This  can  be  used  to  model  spoilage  in  the  diet  problem  where  x 


j 


are  the  amounts  of  food  ordered  and  a^x^  the  amounts  spoiled 


chat  cannot  be  used  at  consumption  time  (a^  would  have  value 


between  -1  and  0 in  this  example) . We  have  now  the  following 
model. 


J 


■ 


Model  II: 


minimize  E 


,L  V1  + 


subject  to  x e u 


Pr°b  {jli  V1  + Vxj  ibi}1Yi  1 " 11  ' 


where  everything  is  defined  as  in  Model  I except  for  a which 
is  an  n * 1 vector  of  random  variables. 

Model  II  overcomes  the  shortcomings  mentioned  for  Model  I. 
However,  we  had  to  pay  the  price  in  increased  complexity.  This 
complexity  will  make  Model  II  much  less  tractable  mathematically 
than  Model  I. 

We  will  now  present  schemes  to  solve  Models  I and  II. 


D.  Deterministic  Equivalents  for  Models  I and  II 
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Definition: 

The  distribution  function  of  a random  variable  X is  the 
function  G(z)  defined  as  G(z)  » Prob  {X  <_  z}  . 

While  the  definition  of  the  distribution  function  presents 
no  difficulty,  we  need  to  define  the  inverse  of  this  function 
for  the  general  case. 

Definition: 

The  inverse  of  the  distribution  function  G(z)  of  a random 
variable  X is  defined  as  follows: 

G_1(y)  * sup  {z  | G(z)  <_  Y> 

for  0 <_  Y 1 and  it  is  undefined  elsewhere. 

We  will  also  need  the  following  functions. 

Definition: 

We  will  call  the  "tilde"  distribution  function  of  a random 
variable  X the  following  function: 

G(z)  ■ Prob  {X  < z}  . 

Its  inverse  is  defined  as: 

G 1(y)  = sup  {z  | G (z)  <_  y) 


for  0 <_  y K 1 and  is  undefined  elsewhere. 
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Note: 


1.  If  X is  a continuous  random  variable  then  G(z)  - 

Prob  {X  < z>  - Prob  {X  < z}  - G(z)  and  G 1('r)  - G 1(y) 


for  0 < y < 1 . 

2.  If  X is  a discrete  random  variable  then  G(z) 
Prob  {X  < z}  = Prob  {X  <_  z - 1}  = G(z  - 1)  . 


We  will  now  proceed  to  define  the  deterministic  equivalents 
mentioned  earlier. 


1.  Model  I 


Theorem  1.1: 

The  following  linear  program  is  a deterministic  equivalent 
to  Model  I: 


U 

minimize  £ c (x  + E^ev 
1-1  2 2 J 


subject  to  x £ !2 


Vi 1 bi  - ? 


(1  - Y1)  i - 1, 


. . , m 


where  G^Cz)  - Prob  < £ Aijej  < 


Proof : 


For  all  i = 1,  . . . , m 


9 
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Proof : 

This  is  Theorem  1.1  with  the  observation  that  G^Cy)  *G^(y)  for 
0 <_  y <_  1 when  e^  j * 1,  n are  continuous.® 

Corollary  1.3: 

If  in  Model  I the  random  variables  are  discrete,  then  the 
following  linear  program  is  a deterministic  equivalent  for  Model  I. 


minimize 


j 


l 1 V’j  + E(ei 


)) 


subject  to  x e 52 


where  G^(z)  * (z  - 1)  * Prob  | J — z " • 


. . , m 


Proof : 


This  is  Theorem  1.1  with  the  observation  that  in  this  case 
G1(z)  » Gi(z  - 1)  . ■ 


2.  Model  II 
Theorem  1.4: 

The  following  nonlinear  program  is  a deterministic  equivalent 
to  Model  II. 
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minimize  £ c.(l  + E(ci.))x 
j-1  3 3 3 

subject  to  x e H 


E Vj  + A1(1  - V -h  1 ' 


where 


i6x(z)  = Prob  \ AijXjaj  < 


Proof : 


For  all  i * 1,  . . . , m 


prob  Aij(i+aj>xj  -bij-yi 


Prob  < 7 A..a.x.  > b.  - T A x . > > 
(j-i  « 3 3 ' 1 j-1  « 3)  " 


1 - Prob 


*b  ij-i  AijaJ*j <bi'  ill  Vjpi 

• 1 - a[‘i  - 1 V,]*  n 

’ ' £ Vj-j]  ^ -i 

bi ' 1 Vi 1 A1'1  ' V 


£V‘J  + Ala-V-b  i- 
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Corollary  1.5: 


If  in  Model  II  the  random  variables  are  continuous  then  the 
following  nonlinear  program  is  a deterministic  equivalent  for 
Model  II. 


minimize  £ c.(l  + E(a.))x. 

j=l  2 22 

subject  to  x e ft 


! Aijxj  + iGx1(1  • V -bi  1 = • 

j=l  J J 


where  .G  (z)  = Prob  < T A..a.x  < z> 
i * ij  3 j ~ i 


Proof : 


By  Theorem  1.4  and  using  the  fact  that  here  .G  (z)  » G (z)  and 

X X i X 


.G^Cy)  = .G"1^)  for  0 1 Y 1 1 .1 


Corollary  1.6: 


If  in  Model  II  the  random  variables  are  discrete,  then  the 
following  nonlinear  program  is  a deterministic  equivalent  to  Model  II. 


n 

minimize  £ c (1  + E(ct.))x. 

j»l  2 2 2 


subject  to  x e ft 


1 Aij’‘J  + icrL<i-vibi 


i = 1,  . . . , m 
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where 


.G’ (z) 

IX 


,G  (z  - 1) 
i x 


and 


iGx(z)  - Prob  AyajXj  1 z|  . 

Proof : 

By  Theorem  1.4  and  using  Che  fact  that  ,G  (z)  ■ G (z  - 1)  .9 

i x i x 

E,  Limitations  of  the  Deterministic  Equivalents  of  Models  I and  II 

The  deterministic  equivalents  presented  in  the  preceding 
section  assume  that  the  convolutions 

(i)  G (z)  = Prob  < £ A .e  <_  z 

(j-1  J J 

(ii)  iGx(z)  = Prob  Aij0jxj  < z 

can  be  calculated  and  the  inverse  can  be  determined  exactly  for 
(i),  and  in  terms  of  x in  (ii).  Although  this  can  be  done  easily 
when  the  random  variables  are  independent  and  have  normal  dis- 
tributions, as  will  be  shown  in  Chapter  III,  in  general  it  is  not 
the  case.  These  convolutions  in  the  case  of  (i)  can  be  very 
difficult  to  calculate  or  in  the  case  of  (ii)  it  might  be  difficult 
to  express  the  inverse  distribution  explicitly  in  one  simple 


expression  of  x . We  will  also  point  out  that  in  practice  the 
distributions  of  the  random  variables  themselves  might  not  be 
completely  known.  So  far  the  discussion  has  been  concerned  with 
determining  precisely  the  coefficients  of  the  constraints;  however, 
another  difficulty  arises:  If  we  succeed  in  calculating  these 
convolutions  and  their  inverses.  Model  I is  a simple  linear  program 
and  can  be  solved.  This  is  not  the  case  for  Model  II.  We  have 
then  a nonlinear  program  which  might  not  only  be  difficult  to 
formulate  but  also  to  solve. 

This  is  why  we  look  for  other  ways  of  solving  Models  I and  II. 

We  will  concentrate  on  obtaining  what  we  call  conservative  approxi- 
mation problems  for  these  models. 

Definition: 

A problem  B is  called  a conservative  approximation  of  a 
problem  A if  and  only  if: 

(i)  The  feasibility  set  of  B is  contained  in  the 
feasibility  set  of  A . 

(ii)  A and  3 have  the  same  objective  function. 

In  the  next  chapter  we  'will  present  a set  C of  random 
arlables  for  vhlcn  conservative  approximations  for  Models  I and 
II  .annoc  only  be  easily  constructed  with  limited  information 
*5'.  tn«  random  variables,  but  also  are  linear  programming  problems. 


CHAPTER  rr 


In  this  chapter  we  present  a set  of  random  variables  C and 
a corresponding  class  C of  densities  and  we  discuss  their 
properties.  These  will  be  useful  for  defining  conservative 
approximations  for  Models  I and  II. 

The  set  C consists  of  the  continuous  random  variables  which 
have  densities  that  are  symmetric,  unimodal  with  maximum  at  0, 
and  with  finite  range.  Examples  of  such  distributions  are  the 
truncated  normal,  the  uniform  distribution,  certain  Beta  distributions, 
the  truncated  double-exponential,  and  many  others.  In  the  context 
of  our  models  such  distributions  can  be  used  to  model  many  real 
situations.  The  fact  that  the  distributions  have  finite  range  is 
certainly  realistic.  The  symmetry  and  being  unimodal  with  maximum 
at  the  mean  are  more  restrictive  assumptions;  however,  anything 
that  can  be  modeled  as  a truncated  normal  would  fit.  As  an  example, 
measurement  errors  can  certainly  be  modeled  using  a truncated  normal. 
Spoilage  is  another  example  which  could  be  modeled  if  the  quantities 
spoiled  tend  to  have  distributions  concentrated  around  their  means. 

We  will  now  turn  to  the  study  of  this  class  of  distributions. 

A.  The  Class  C of  Densities  and  the  Set  of  Random  Variables  C 
Definition  2.1: 

C is  the  class  of  densities  f such  that  f t C if  and 
only  if 

a)  f is  symmetric  around  0 : Vx  e (-a0,+00)  f (x)  ■ f (-x)  . 


b) 


f 


is  unimodal  with  maximum  at  0. 
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c)  f has  finite  range:  3a  , 0 < a < +»  such  that 
f(x)  * 0 for  x £ [-a,+a]  . 

d)  f is  continuous. 


Notation: 


The  distribution  function  of  a random  variable  having  density 

x 

f is  denoted  by  F(x)  = J*  f(u)du  . 

— 00 

This  class  C has  well-known  properties  that  can  be  derived 
from  the  symmetry  of  the  densities. 


ProDosition  2.2: 


If  X is  a random  variable  with  density  f e C then  the 
following  properties  hold: 


(i)  ECX)  - 0 

(ii)  F(x)  = 1 - F(-x)  Vx  e (-0O,+a>) 

(iii)  F (0)  - i . 


Proof : 


(i)  E (X)  = J*  xf(x)dx  = j*  xf(x)dx  + j xf(x)dx 

.00  —CO  0 

changing  variables  in  the  second  integral  to  u = -x 


xf (x)dx  + 


J (-u)f(-u 


) (~du) 


xf(x)ax  - I xf(-x)dx  . 
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However  by  a)  of  Definition  2.1  f(x)  » f(-x)  Vx  t (-»,<*) 


(X)  = J (x  - 


x)f(x)dx  = 0 . 


(ii)  F(x)  = J f(u)du  changing  variables  to  v * -u 


f (-v) (-dv) 


I 

j f (-v 


)dv  . 


By  symmetry  of  f : f(-v)  = f (v)  Vv 


f (v)dv 


f(v)dv  - | f(v)dv 


1 - F(-x) 


(iii)  By  (ii) 


F (0)  - 1 - F (0) 
=<>  2F (0)  « 1 


F(0)  = f . 
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Definition  2.3: 

For  a density  of  the  class  C the  inverse  of  the  distribution 
function  F(x)  is  defined  to  be: 


1-1  (0)  * max  {z 

| F (z)  = 0} 

' ^"(1)  = min  {z 

| F (z)  = 1} 

and  for  0 < y < 1 

f"L(y)  = U | F(z)  = '(}  . 

Using  this  definition  more  properties  of  C are  presented 
below: 

Proposition  2.4: 

For  any  density  f s C having  range  [-a,+a]  the  following 
holds : 

(i)  F-1(0)  « -a  and  F_1(l)  * +a 

(ii)  F-1(j)  = 0 . 

Proof : 

(i)  Apply  Definition  2.3. 

(ii)  Apply  (iii)  of  Proposition  2.2. 

Theorem  2.5: 

If  X is  a random  variable  with  density  f e C then  for 
all  real  numbers  c , cX  is  a random  variable  with  density 
belonging  to  C . 


19 


Proof : 

Call  g(x)  the  density  of  cX  . Then  g(x)  - f|^j  . 

a)  g(x)  - g(-x)  Vx  e (-«,+•)  since  g(x)  - ~ j 

£[t)  “ g(_x)  • 

b)  Case  l:  c ^ 0 as  g(x)  =•  f^-j  g(x)  is  unimodal  with 


maximum  at  0. 

Case  2:  c < 0 g(x)  » f|^j  = 


by  symmetry  of  f 


and  this  is  the  same  as  Case  1. 
c)  g(x)  = has  finite  range 


['  I -+ 1] 


for  c > 0 or 


for  c < 0 . 


Definition  2.6: 

Call  C the  set  of  random  variables  which  have  a density 
belonging  to  C . 

Theorem  2.7: 

If  X £ C and  has  a distribution  function  F and  cX  has 
a distribution  function  G (c  real  number)  then: 

VY  e [0,1] 

G_1(y)  * |c|f-1(y)  . 

Proof : 

VY  e [0,1]  3 z such  that 


z - G_1(y) 


20 


Case  l:  c > 0 


Case  2:  c < 0 


G(z)  = y 

Y * Prob  {cX  <_  z}  . 


Y = Prob  jx  £ 

- V - p(f) 


-1 , , Z 

F (Y)  - “ 


=■*  z = cF  '''(y) 
G_1(y)  = cF_1 (y)  • 


1 - Prob  {x  1 

- Ffftr) 


since  X e C 


--I,  \ z 

« f (y)  - -pry 
g_1(y)  - |c|f-1(y) 
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Theorem  2.8: 

If  f e C , j ■ 1,2  , then  the  convolution  * fj  e C . 
Proof : Vf^  and  f^  e C 

8 - fl  * f2  ' 

a)  g is  symmetric 

Vz  e 
+® 

g(z)  = f f1(z  - u) f 2 (u)du 


changing  variables 


u = -v 


f^z  + v)  f 2 (“V ) (-dv) 


’/ 


f^(z  + v)f2(-v)dv 


since  f^  and  f2  are  symmetric 


g(z)  * J”  ^(-z  - v)f2(v)dv 


g(-z)  . 


b)  It  is  sufficient  to  show  that  g(z)  is  increasing  in  z 
for  z<0  or  Vz  < 0 and  dz  > 0 such  that  z + dz  < 0 


g ( z + <5z)  - g(z)  >_  0 


Then  by  symmetry  g(z)  is  unimodal  with  maximum  at  0. 


g (z  + dz)  - g ( z ) 


j f 1 (z  + dz  - u)f2(u)du  - J f^(z  - u) f 2 (u)du 
z <5z 

J [f1(z  + dz  - u)  - - u) ]f 2(u)du 


j * [f-^z  + dz  - u)  - f^z  - u)  ] f 2 (u)du  . 

z +y  dz 


Changing  variable  in  the  first  integral  to  v*2z+5z-u 


g(z  + dz)  - g(z) 


.1  - 
z + — oz 


j [f^(-z  + u)  - f^(-z  - dz  + u)]f2(2z  + dz 
+» 

+<=° 

t-  j [f-j^Cz  + dz  - u)  - f2(z  - u)]f2(u)du  • 


Z +-J  dz 


Since  f^  is  symmetric 
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f 1 C— z + u)  » f1(z  - u) 


f^(-z  - 5z  + u)  = f^(z  + ^z  “ u) 


-*►  g (z  + <5z)  - g(z) 

J [f1(z  + (Sz  - u)  - f1(z  - u)](f2(u)  - f2(2z  + 5z  - u))du 


+® 


z +-j  6z 


The  proof  will  now  proceed  as  follows.  We  shall  show  that: 


1)  f^(z  + <Sz  - u)  - f1(z  - u)  >_  0 for  z + — <Sz  <_  u <_ 


2)  f2(u)  - f2(2z  + dz  - u)  0 for  z + -^  6z  <_  u <_ +*> 


Then  it  is  clear  that  the  whole  integral  is  nonnegative  and 
g (z  + Sz)  - g(z)  >_  0 . 


1)  Case  l: 


z+Y5z<_u<_z  + 6z 


-z  - iz  < -u  <_  -z  - j 6z 


-<5z  < z - u < - j 5z 


and 


O^z  + Sz-u^jSz 


0£z  + 5z-u<_2^z1-  (z-u) 
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As  £ C , f j is  symmetric  and  unimodal  with  maximum  at  0. 


f,  (z  + 5z  - u)  >_  f1  (-(z  - u))  “ f.  (z  - u) 


f^(z  + 6z  - u)  - f^(z  - u)  >_  0 


Case  2: 


z + 5z  < U < -H=  . 


Then 


z + 5z  - u < 0 


as  5z  > 0 


z-u<z+6z-u<0 


since  e C f^(x)  is  increasing  for  x <_  0 and  f^(z  + 6z  - u)  - 


(z  - u)  >_  0 


2)  Case  l: 


Z+j3z£u<0 


0 < -u  < -z  - 2 


2z  + Sz  < 2z  + Sz  - u < z + » (Sz 


2z  + Sz  -u<_z+  — 5z<_u<_0 


as  f.  £ C , f2(x)  is  increasing  for  x <_  0 


f9(u)  - f0(2z  + Sz  - u)  > 0 . 


J 
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Case  2: 


u < 0 < -H» 

f,(u)  - f,(2z  + 5z  - u)  3 f2(u)  - f2(u  - 2z  - 5z) 


since  f-  is  symmetric. 


However 


2z  + <5z  <_  0 
0<u<u-2z-6z 


as  f2  e C f 2 (x)  is  decreasing  for  x>  0 


f2(u)  - f2(u  - 2z  - 5z)  > 0 


c)  If  f , j ■ 1,2  , have  ranges  [-a^,+a^]  then  * f2 


has  a finite  range: 


[-a1  - a2,a1  + a2] 


as 


(f  * f 2)  (z)  3 0 for  z £ [_a]_  “ a2,al  + a2^  since 


f (z)  3 0 for  z i [~aj ,aj 1 for  j 3 1,2 
d)  Since  ^ and  f2  are  continuous, 

+00 

fx  * f2  - J fL(*  - u)f2(u)du 


is  continuous. 


Note: 

An  alternate  proof  for  b)  is  outlined  in  a note  on  page  164 
of  William  Feller's  book  [7].B 
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Corollary  2.9: 


If 

j - 1. 


Xj  J - 1, 
. . , n Chen 


. . • , n are  independent  and  such  that 


I X e C . 
j-1  J 


X,  e C 
J 


Proof : 

• True  for  n = 1 

• True  for  n = 2 by  Theorem  2.8 

• Assume  it  is  true  for  n = k 

k 

i.e.,  g =■  * f . » f . density  of  X . 

K j-1  2 2 J 


Then  gk  e C . 

However  gk  * fk+1  = gk+1  e C by  Theorem  2.8. 
true  for  k + 1 and  true  for  all  n . 


Therefore  it  is 


Corollary  2.10: 

If  the  independent  random  variables  j = 1,  ...»  n belong 

n 

to  C , then  for  all  real  numbers  c j = 1,  ....  n : £ c.X  e C 

J j-1  J J 


Proof : 


Apply  Theorem  2.5  and  Corollary  2.9. H 
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B.  Bounds  on  the  Distribution  Function  of  the  Sum  of  Random  Variables 
Belonging  to  C 

Theorem  2.11: 

If  Xj  e C j * 1,  n are  independent  with  distribution 

n 

functions  F and  calling  G - * F then: 

J j-1  J 


For  - l F~L(0)  > x > 0 

J-1  J 


< G(x)  . 


For 


n 

+ I 

j-1 


(0)  < x<  0 


G(x)  < 


n 1 

x - l F,a(0) 

J-1  J 

- 2 l Fj1 (0) 

J-1  J 


Proof: 

n n 

By  Corollary  2.9  £ X t C ; therefore,  g = * f is 

j-1  J j-1  J 

unimodal  with  maximum  at  0.  Therefore  g(x)  is  increasing  for 

x 

x < 0 and  hence  G(x)  - f g(u)du  is  convex  for  x <_  0 . Further- 


more, we  know  that 


r 
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(k  F"<0>) 


and 


l fT1(0)  > - 


j-1 


G(0)  - j . 


Therefore  G(x)  has  for  upper  bound  the  straight  line  from 


^ F^(0),oj  to  (o,  jJ  . 


For  x < 0 , 


n 


x - I fT1  (0) 

j-1  3 

- 2 l F'^O) 
j-1  J 


G(x)  < 


Since  G(x)  e C it  is  symmetric  and  by  symmetry  for  x >_  0 


x - l F‘X(0) 

1=L 2 

- 2 l F /(0) 

1-1  J 


< G(x)  . 
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For  x > 0 


G(x)  <_  rain  {F . (x) } . 
j*l» • • • »n  2 


For  x < 0 


max  {F  (x)}  <_  G(x)  . 
j»l, . . . ,n  2 


Proof : 


It  is  sufficient  to  prove  that  for  x <_  0 F^  (x)  <_  G(x) 


V j =*  I , ....  n 


Proof  by  Induction: 


For  n = 1,  trivial  F^ (x)  <_  F^ (x) 
For  n = 2 


For  x < 0 


G- (x)  - F (x)  (j  = 1,2  , G~(x)  * F 

2 j \ k*j 


1 * V*>) 


J * (x  - u)f^(u)du  - F^ (x) 


F^(x  - u)f,^(u)du  - J * 


Fj (x)fk(u)du 


since 


I 

/ V 


)du  * 1 
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+® 


/ 


[F^(x  - u)  - Fj (x) ] f^(u)du 


/ 'V’ 


v/ 

(x  - u)  - Fj (x) ]fk(u)du  + J [Fj(x  - u)  - Fj (x) ]fk(u)du  . 


Changing  variables  in  the  second  integral  u = -t 


+°° 


■/ 


(x  - u)  - F . (x) ] f,  (u)du  + / [f.(x  + t)  - F (x) ] f (-t)(-dt) 

J k J 1 1 * 


since  f^Cu)  is  symmetric: 


-H*> 


J [F^(x  - u)  + Fj (x  + u)  - 2Fj (x) ]fk(u)du 


f (u)  0 Vu  it  is  sufficient  to  show  that  [F.(x  - u)  + F.(x  + u)  - 

lc  J J 

2Fj  (x)  ] >_  0 for  u e [0,+“]  to  insure  that  G2(x)  - F^  (x)  >_  0 
and  G2(x)  >_  F^  (.x)  j *1,2  . 

1)  For  u = 0 

[Fj  (x  - 0)  + Fj(x  + 0)  - 2F j (x)  ] * 0 . 

2)  For  0 <_  u <_  +* 

[F  <x  - u)  + Fj(x  + u)  - 2Fj(x)] 


is  an  increasing  function  of  u since  its  derivative  is: 
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-f  j (x  - u)  + f j (x  + u)  = f j (x  + u)  — f ^ (u  — : 

since  f is  symmetric  and  unimodal  and  |u  - x|  >_  [ x 
for  0 <_  u <_  +°°  . 

a)  0<_u<_-x=*>x<.x  + u<_0<_-x£u-x 

b)  -x<_u<_-H»=*>0^x  + u<_u-x  . 

Therefore  it  is  true  for  n «■  2 . 

• Assume  it  is  true  for  n = k . 

Then  for  x <_  0 

Fj  (x)  iGk(x)  * " L’  k ’ 


Since  C is  closed  under  convolution  the  density 
Then  by  the  proof  for  n * 2 : 

For  x < 0 


Gkw  i \ * W*>  • Gk+i« 
Fk+llx>  - Gk  Fk+l(x)  * Gk+l<x)  • 


Therefore: 
For  x < 0 


F_-  (x)  i.  G^(x)  for  j = 1,  . . . , k + 1 


:)  1 0 
+ u| 


gk(x)  e C . 


It  is  true  for  all  n . ■ 
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Theorem  2.13: 


For  all  X . t C j - 1,  ....  n independent 


random  variables 


with  distribution  function  and  all  real  numbers  j = 1,  ...»  n , 


G(x)  = Prob 


!n  ) n -1 

I c .X.  <_  x>  is  such  that  for  - £ | c . | F . (0)>_x>_ 

J-l  2 2 ) j-1  J J 


x-  l | C . 1 f”1 (0) 


- 2 I |c  |F": 
j=l  J J 


<_  G(x)  <_  min  (|c.|F.(x)} 
j-l, ... ,n  2 2 


-1 

and  for  £ | c . | F (0)  <_  x 0 

j-l  J 2 


- I IcjF^CO) 


max  (|c.|f.(x)}  <_  G(x)  <_ 
j-l,...,n  2 2 


-2  l |c  jF^tO) 
j-l  J 1 


Proof : 


Apply  Theorem  2.12  and  2.11  and  Corollary  2.10  and  Theorem  2.7. 


Corollary  2.14: 


For  all  Xj  e C j - 1,  ...,  n independent  random  variables 
with  ranges  [-a^.+a^]  and  all  real  numbers  c^  j-l n , 

G(x)  = Prob  < J c.X.  < x>  is  such  that: 

b-i  J J“  ) 


LI 

For  l |c  |a  >_  x >_  0 
j-l  J 2 


X + 


l 1‘jl‘j 
i-J  1- 1 


< G(x) 


2 I |c.| 


j-1 


y j 


and 


11 

for  - l | c . | a , < x l 
i=l  J J 


G(x) 


X+  I |c  |a. 

< J-1  ■— 

2 I k.|a 

j-1  J 2 


Proof : 


Apply  Theorem  2.13  with  f“L(0)  - -a^  from  Proposition  2.4. 


Theorem  2.15: 


For  all  X eC  j * 1,  ...»  n independent  with  ranges 

j 

[— a. ,+a.]  and  real  numbers  j = 1 n , if 

G(x)  = Prob  | l CjXj  <_  xj  it  is  true  that: 

For  0 < y <y 


(2y  - 1)  l | c . 1 a . <.G~1(y)  1 min  { I c.  | F"1  (y)} 
j-1  2 2 j-1, • • • ,n 

For  1 > Y > 7 

n 

max  i|c.|F  ^(y)>  1.  G ^(y)  £.  (2y  ” 1)  I !C-Jaj 
j-1, . . . ,n  ' J 2 ’ j=1 
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Proof : 


This  is  just  a different  way  of  stating  Theorem  2.13.  As 

X.  e C , all  the  inverses  of  are  concave  and  so  is  G ^ (y) 

n ^ 

and  (2y  - 1)  £ |c.|a.  is  just  the  straight  line  joining  G x(0)  , 

j=l  J 3 

G ^(1)  and  going  through  G • The  concavity  of  G ^(y) 

explains  the  inequalities. 

As  both  Fj  and  G are  strictly  increasing  in  their  ranges 
as  Xj  e C for  all  j =*  1 , ....  n , then  it  is  clear  that 


-1, 


Vx  £ (-°°,0]  |Cj'Fj  ^ 1 G(x)  . 


Then  y e [o,  y]  , |cj|F‘1(y)  > G_1(y)  .1 
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CHAPTER  III 

In  this  chapter  the  results  of  the  previous  chapter  are  used 
to  find  conservative  approximations  to  Models  I and  II.  The  normal 
case  is  treated  separately  at  the  end  of  the  chapter. 

A.  A Conservative  Approximation  to  Model  I 
Theorem  3.1: 

If  e.  e C j = 1,  ....  n with  ranges  [-a  ,+a  ] , the  following 

j J J 

linear  program  is  a conservative  approximation  to  Model  I for  Y ii. 


i 


T 

minimize  c x 
subject  to  x c ft 
n 


J -Vi  i bi + <2yi  - “ £ 


I j ! 


i = 1, 


m 


Proof : 


T 

(i)  The  objective  function  is  c x since  Vj  E(e^)  * 0 


as  e^  e C 


(ii)  From  Theorem  2.15  it  is  clear  chat  for  G^z) 

^ijej 


Prob  j l Aiiei  - z|  and  Yi  - I Vi  “ 1 m 


(2(1  - Yi)  - 1)  ^ aj  I ^ij  I -Gi1(1  " V 


(1  - 2Yi)  ^ ajlAijl  1 Gi1(1  “ Yi)  * 
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Using  the  deterministic  equivalent  of  Theorem  1.1  it  is  true 
that  if  x is  such  that  for  all  i = 1,  m , 


1 Vj  1 bi + <2Yi  - l)  laJ|Au 


Then 


V3-bi-Gi1(1-V 

j =1  J J 


since  (2y. 


. - 1)  l a | A . | >_  -G.1(l  - y ) and  therefore: 
1 J 1 1 

Prob  1 J A . . (x . + e.)  > b.|  > y.  for  all  i 

h-i  1J  J j - i - i 


Hence  it  is  a conservative  approximation  to  Model  I.  ■ 

B.  A Conservative  Approximation  to  Model  II 
Theorem  3.2: 

If  the  of  Model  II  contains  the  set  {x  J x >_  0}  and  if 
e C j =*  1,  ....  n with  ranges  [-a^,+a^]  , the  following  linear 
program  is  a conservative  approximation  to  Model  II  for  y >_  y . 

T 

minimize  c x 
subject  to  x e ft 


I U + (1 
J-l  J 


" 2TT±)  lA^  I a j ] x j 1 bi  i - 1, 


• • a HI 


Proof : 


(i)  The  objective  function  is  cx  since  E{a^ } 
j = 1,  • ■ ■ * n as  cij  - C • 

(ii)  If  we  call 


0 for 


iV')  • Ptob  j j1  AijVj  i2| 


Using  again  Theorem  2.15  and  the  fact  that  x >_  0 . 


for  Yi  i - 1,  ....  n 


(2(1  - Y 


s1'1  - V 


11  ' 2Yl>  jL  13|AU,,j  -1 


c"  (1  - Y J 


Using  the  deterministic  equivalent  of  Theorem  1.2  it  is  true 
that  if  x is  such  that  for  all  i ■ 1,  ....  m : 


lAy  * (1  - 2T1)|Alj|.j]*j  > bt 


^ Vj  + (1 ' 2V  ^ |Aii|aixi  -bi 


and 
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£ A»xi  + i' 


Gx1(l  - 


i I A..x  + (1  - 2v  ) I |A,Ja.x.  > b. 

4 _1  !■  J J i 4 


j-1 


j-1 


ij'  j j - i 


and  finally 


ij 

Thus,  this  is  a conservative  approximation  to  Model  II.  ■ 

C.  Special  Cases  for  y = 1 and  y ■ 4 

These  two  models  presented  in  Theorems  3.1  and  3.2  are  linear 

programs  and  thus  can  be  solved  using  the  simplex  method.  They 

do  not  yield  the  exact  solution,  but  in  the  absence  of  a method 

to  obtain  the  exact  solution  these  are  valuable  problems  as  they 

give  us  a feasible  solution  set  and  an  optimum  for  that  solution  set. 

It  is  also  to  be  noted  that  the  solutions  are  exact  for  y = 1 and 
1 

Y = 2 • 

For  y * 1 , since  the  random  variables  have  finite  range,  the 
problem  is  reduced  to  a linear  program  with  the  random  variable 
having  their  "worst"  values.  This  yields  the  programs: 


!n 

l A 

j-1 


(1 


+ Vxj 


:li  K'i 


for  all  i 


Model  I: 


minimize  c x 
subject  to  x e !1 
n 


|Ay|ai  1 


1,  . . . , m 
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Model  II: 

T 

minimize  c x 
subject  to  x e Q 

- |Au|aj)xj  ^bi  1-1>  ••••" 

when  {x  | x >_  0}  C !1  . 

For  y = , since  the  random  variables  are  symmetric,  the 

problem  is  reduced  to  the  linear  program  where  all  the  random 
variables  are  set  equal  to  0.  This  yields  the  two  identical  programs: 

Model  I: 

minimize 
subject  to 
Ax  >_  b 

Model  II: 

minimize 
subject  to 
Ax  > b 

We  will  now  prove  these  statements 

Theorem  3.3: 

(i)  Model  I and  the  problem  of  Theorem  3.1  are  identical 
for  y “ y and  y * 1 • 

(ii)  Model  II  and  the  problem  of  Theorem  3.2  are  identical 
for  y = \ and  y * 1 • 


x t ft 


T 

c x 
x e ft 

in  the  following  theorem. 


I 

j=l 


(A 


ij 
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Proof : 

(i)  For  y ■ 1 


(2Yt  - 1)  l 


lAij |aj 


n 

I 

j-1 


Aij  aj 


G?1 (1) 


Vi  » 1, 


and  for  y 


1 

2 


(2y  - 1)  l I A | a 

1 j-1  -1  2 


1, 


m . 


(ii)  Similarly 

<2„i  - 1)  £ lAyl.jXj  - lAyl.jIj  - 

for  y * 1 , Vi  = 1,  . . . , m ; 

<2ti  - » jL  ■ 0 • aIi) 

f°r  Yt  -y  , Vi  = 1,  . . . , m . 
Therefore,  the  constraints  are  identical. ■ 


Note: 

It  should  be  noted  that  all  previous  results  can  be  extended 
to  random  variable  and  with  nonzero  means  but  for  which 
the  random  variables  e^  - E(e^)  and  - E(cO  belong  to  C . 
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D.  The  Normal  Case 


The  normal  distribution  does  not  belong  to  the  class  C , 
however  as  it  is  important,  it  shall  be  treated  separately  in 
this  section.  The  special  properties  of  the  normal  distribution 
enables  us  to  formulate  workable  deterministic  equivalents  for 
Models  I and  II. 


Theorem  3.4: 


If  e^  j = 1,  ...,  n are  distributed  normally  with  means 

2 

Uj  and  variance  , then  the  following  linear  program  is  a 

deterministic  equivalent  of  Model  I. 


n n 

minimize  £ c.x.  + £ c.u. 

j=l  33  j-1  3 3 


subject  to  x e Q 


V: 1 bi  ‘ jL  Vi  ' *'1(1  - V ( X 


i * 1,  . . . , m 


where  4>(z)  is  the  distribution  function  of  the  standardized  normal 
with  mean  0 and  variance  1. 


Proof : 


Pr°b  Ayfcj  + «j>  » 

”*  l *11*!  ibl  - GIl<1  - V 


roll-1 
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where 


Gi(z) 


Prob 


n 

; i 

j-i 


A.  .e.  < z, 
y j - 


by  Theorem  1.1. 


However  since 


e . 
3 


have 


N(y^ ,0^) 


as  distributions,  then 


is 


N 


A.  . y . 
ij  3 


Gi(z)  = 4> 


Hence  if  (1  - Y^)  3 G^(z) 


Ji  Ali“j 


and 


Hence  for  all  i = 1,  m 


Prob  + e.)  1 b±j  > 


U 

I Aijxi  i 

i=*l  2 


bi  - 0^(1  - y^)  by  Theorem  1.1 


.2  2\2 


.1,  Vi  -bi  - .1,  Vi  ‘ ♦“  11 ' Yi Vj 


Theorem  3.5: 


If  ci^  j = 1,  ....  n are  distributed  normally  with  means 

2 

U.  and  variance  a?  , then  the  following  convex  program  is  a 


deterministic  equivalent  of  Model  II. 


Proof : 


U 

minimize  £ c . (1  + y.)x. 

j-1  2 J 2 

subject  to  x £ Q 

j,  v1  + v*i  + *'1[i  - ^ j,  ^H)1  - bi 


I V + A 11  - V i bi 

j-1 


where 
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( n 

,Gx(z)  = Prob  AyCl  + a.)x.  1 b± 


by  Theorem  1.2. 

However  since  a.  have  for  distributions  N(u.,a.) 

3 3 3 


2 2 2 \2 


.Gx(z)  is  normal  N H Vj'j 


iGx(z)  = ♦ 


n 

- y a..x.u. 

4i  j J 


/ r . 2 2 2^2 

) A.  .a.x. 

L\j-i  11 J y J 


Using  the  same  reasoning  as  in  the  proof  of  Theorem  3.4 


.G~1[l  - y . 

IX  1 


.]  = l A y x + ^_1[1  - y.](  l A2.o2x2'2 


Hence  for  all  i = 1,  ...»  m 


Prob 


1 A..x,  + G [ 1 - y • ] > b . 

ij  j i x V - i 

£ V1  * + rl[1  - n'jj,  AiJ»H)2  i \ • 


The  program  thus  obtained  is  convex  since  the  above  expression 
is  concave.  This  was  shown  in  the  literature  in  [ 3 ] . ■ 


If  one  does  not  wish  to  solve  the  preceding  convex  program 
using  the  usual  convex  programming  algorithm,  a conservative 
approximation  for  Model  II  can  be  derived  in  the  normal  case.  This 
applies  if  we  have  the  constraint  {x  | x >_  0}  included  in  the 
set  ft  . 


Theorem  3.6: 

If  in  Model  II,  {x  | x >,  0}  c ft  and  a j = 1,  . . . , n are 
normally  distributed  with  means  and  variances  a?  , then  for 

^ — 2 linear  program  is  a conservative  approximation 

for  Model  II. 


minimize 


l c (1  + u.)x. 


subject  to  x e ft 


X [u + uj,Aij + *"1<i  - yi)°1  iAy  o *]  i bi 


x > 0 . 


Proof : 


This  can  be  established  using  the  following  two  facts: 


1)  For  x j>  0 Vi  - 1,  ....  m 


(Ji  ,4u|xi°j)2i  Xa«Vj 


I lAjJaiXi  -(  i A2  a2x2)2  . 
1-1  Lj  j j \j-l  13  3 3/ 


' 
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2)  For  y >t 


♦-1ll  - y ] < 0 Vi  i - 1,  m 


Hence  by  1)  and  2) 


-1  n 

<f>~  [ 1 — Y . ] 5]  I A.  . {o.x.  < 
i ' i .^L  i]  ] ] ~ 


$ [1  - 


2 2 2\2 


Y.]  I AT . afxf 

1 \j-l  J ^ 


Therefore 


Ti  > j 1 f°r  i = 1 “ if  x >_  0 satisfi 


les 


[(1  + VA« + *’1[1 ' Yi,|Aiji'’j]xj  -bt 

n n 

T (1  + u.)A,.x.  + <j>  [1  - Y.]  y 1 A . . | a . > b.  . 
3 iJ  3 i 13l  J “ i 


Then 


r .2  2 2\2 


£ (1  + Wi  + ♦"  U ' Yi]yx  AijVj, 

> JL  (1  + Vj)Aijxj  + - Yj  Lb. 

~ Pr0b  | j,  Aii(1  + ai)xi  -bi}  ~Yi  * 


J = 1 


This  problem  is  a conservative  approximation  to  Model  II.  ■ 


I 
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CHAPTER  IV 


A.  Sensitivity  Analysis 

In  this  chapter  we  will  study  the  sensitivity  of  the  optimal 
solutions  of  Models  I and  II  with  respect  to  the  following  four 
characteristics  of  the  model. 


1) 

2) 

3) 

4) 


The  cost  vector  c . 

The  right-hand  side  b of  the  constraints. 

The  probability  vector  y . 

The  distributions  of  the  random  variables  (e^.  j = 1,  . 
for  Model  I and  j = 1,  ....  n for  Model  II). 


m 


B.  The  Objective  Function  and  the  Right-Hand  Side 
1.  Model  I: 


Model  I presented  in  either  its  deterministic  equivalent  form 
or  conservative  approximation  form  is  a linear  program  and  sensitivity 
analysis  on  the  cost  vector  or  the  right-hand  side  can  be  performed 
in  the  usual  manner  according  to  linear  programming  theory. 

When  the  approximation  is  used,  although  we  have  no  guarantee 
that  a change  in  the  approximate  problem  will  reflect  exactly  a 
change  in  the  original  problem,  we  can  confidently  say  that  in  some 
cases  it  will  give  an  indication  of  the  effect  of  that  change. 

For  example,  if  the  right-hand  side  b is  modified  as  to  expand 
the  original  feasibility  set,  it  is  easy  to  see  that  the  feasibility 
set  of  the  conservative  approximation  will  also  be  expanded. 


Similarly,  a change  in  the  cost  vector  c in  the  conservative  approxi- 
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mation  will  yield  the  conservative  approximation  to  the  modified 
original  problem.  In  short,  if  in  the  absence  of  other  valid 
method,  we  are  ready  to  settle  for  this  conservative  approximation 
solution,  then  the  sensitivity  analysis  of  the  conservative  approxi- 
mation will  give  us  results  of  the  same  validity  as  the  solution 
for  which  we  settled. 

2.  Model  II: 

Model  II  in  its  deterministic  equivalent  form  is  a nonlinear 
program  and  the  sensitivity  analysis  will  have  to  be  performed 
according  to  the  specific  nonlinear  program  that  Model  II  represents. 
However,  we  have  noted  that  we  might  not  be  able  to  obtain  this 
formulation  explicitly,  in  which  case  we  cannot  solve  the  original 
problem.  Here  the  conservative  approximation  derived  earlier 

will  prove  to  be  useful.  In  the  case  the  a j = 1 n belong 

to  the  set  C and  y > ^ , the  conservative  approximation  was 
shown  to  be  a linear  program  in  Theorem  3.2  and  the  usual  sensitivity 
analysis  on  the  cost  vector  and  the  right-hand  side  can  be  performed 
using  the  theory  of  linear  programming.  It  is  important  to  note 
that  this  procedure  will  yield  the  exact  behavior  of  the  optimal 
solution  with  respect  to  variations  in  the  cost  vector  and  the  right- 
hand  side,  only  when  Y ” T and  y = 1 . For  \ < y < 1 conserva- 
tive approximations  will  be  obtained;  that  is  to  say  the  optimal 
solutions  will  belong  to  a subset  of  the  feasibility  set  and  will  be 
optimal  among  that  subset.  The  motivation  for  using  this  approxima- 
tion is  the  same  as  discussed  previously  for  Model  I. 
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C.  The  Probability  Vector  y 

Y is  given  a priori  in  Models  I and  II.  One  might  be  interested 
in  the  effect  on  the  optimal  value  of  the  objective  function  of 
relaxing  the  probability  constraints  by  decreasing  y or  tightening 
the  probability  constraints  by  increasing  y . For  example,  if  the 
probability  constraints  represent  production  standards,  what  will 
be  the  effect  of  modifying  these  standards  on  the  optimal  expected 
cost?  The  analysis  can  be  performed  in  many  different  ways: 
modifying  one  constraint  at  the  time,  or  many  constraints. 


1.  Model  I: 


Both  the  deterministic  equivalent  and  the  conservative  approxi- 
mation are  linear  programs  with  y in  the  right-hand  side  and  the 
usual  sensitivity  analysis  of  the  right-hand  side  can  be  used. 

The  motivation  for  using  the  approximation  has  been  discussed  in 
the  previous  section.  Here  we  may  add  that  the  sensitivity  analysis 
can  be  performed  easily  on  the  approximation  since  the  right  side 
is  a linear  function  of  y . If  we  choose  to  change  only  one  y^ 
or  modify  all  y^  i ■ 1,  ...,  m by  the  same  ratio,  we  have  the 
usual  one  dimensional  sensitivity  analysis.  However  if  we  choose 
to  modify  more  than  one  or  in  general  modify  y , then  this  is  a 
multidimensional  sensitivity  analysis  and  it  is  discussed  in  Walters 

[14]. 

The  conservative  approximation  for  Model  I when  e^  e C 
j * 1,  ....  n and  y can  be  formulated  as: 
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T 

minimize  c x 
subject  to 

n n 

l A x >.  b + (2y.  - 1)  l | A |a  i » 1 m 

j-1  1J  J 1 1 J-1  J 

or  in  a more  convenient  notation: 

T 

minimize  c x 
subject  to  Ax  b + By 

where  B is  an  n * m matrix  with 

B.  . = 0 for  i j 
ij 

and 

n 

B . . = 7 j A . | a . i * 1,  ...»  m 

ii  ij  J 

and 

n ■ 2yi  - 1 • 

The  most  general  sensitivity  analysis  would  be  to  find  all 
optimal  solutions  for  0 <_y  < 1 * 

Of  course  if  we  know  the  exact  form  of  the  deterministic 
equivalent,  we  should  perform  the  sensitivity  analysis  on  this 
problem  and  get  exact  results.  However,  it  cannot  be  done  directly 
as  sensitivity  analysis  of  the  right-hand  side  of  a linear  program, 
because  the  right-hand  side  is  not  a linear  function  of  y . The 
usual  sensitivity  analvsis  can  be  performed  for  the  parameter 
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X ■ (X.  , X ) where  X - G^Cl  - y.)  i » 1 a and 

1 m ill 

Chen  later  converted  back  to  y using  the  formulas: 

* 1 - Gi(xi)  i * 1.  • • • . m . 

Here  again,  as  described  for  the  approximation,  one-dimensional 
or  multidimensional  analysis  can  be  performed. 

2.  Model  II: 

In  this  case  the  y vector  is  not  represented  in  the  right- 
hand  but  in  the  left-hand  side  of  the  constraints.  We  will  not  deal 
with  the  deterministic  equivalent  as  the  left-hand  side  is  dependent 
on  the  distribution  of  the  random  variables  and  is  different  for 
every  problem.  However  we  will  mention  that  for  the  conservative 
approximation,  the  one-dimensional  case  is  a parametric  column 
linear  program  and  this  problem  has  been  treated  in  Lawrence  [9]. 

J 

D.  Variations  in  the  Distribution  Functions  of  the  Random  Variables 

In  this  type  of  sensitivity  analysis  the  probability  vector  y 
has  been  specified  and  cannot  be  changed;  however,  the  distribution 
functions  of  the  random  variables  can  be  modified.  For  example, 
if  the  random  variables  represent  error  in  measurement,  replacing 
the  measuring  device  with  a more  precise  one  will  alter  the  distribu- 
tion functions  of  the  errors. 

In  the  deterministic  equivalent  approach,  a change  in  the  dis- 
tributions of  the  random  variables  produces  a corresponding  change 
in  the  convolution.  Since  it  is  very  difficult  to  describe  mathe- 
matically this  relationship  for  a general  enough  case,  we  will 
concentrate  our  efforts  on  the  conservative  approximation  approach. 


1.  The  Change  in  Distribution  Functions  for  Random  Variables 
Belonging  to  c : 


From  the  formulation  of  the  approximations,  the  main  relevant 
change  in  the  distributions  of  which  we  want  to  keep  track  is 
the  change  in  the  range  of  the  densities.  However,  it  is  important 
that  the  modified  random  variables  still  belong  to  C for  the 
approximation  to  be  meaningful.  We  will  give  two  examples  of 
such  changes.  A random  variable  X e C with  density  f , 
distribution  function  F and  range  [-a,+a]  will  be  considered. 

We  want  to  reduce  the  range  to  [~9a,+9a]  where  0 < 9 < 1 . 


Example  1:  Truncation 

The  new  random  variable  X will  have  range  [-9a,+6a]  and 
the  following  density  f and  distribution  function  F . 


f (x) 


F(x) 


0 x < -9a 

f(x) 

F (9a)  - F (-9a) 

v0  x > 9a  . 

"0  x < -9a 

F (x)  - F(-9a) 

1 F(9a)  - F (-6a) 

,1  x > 9a  . 


-9a  < x < 9a 


-9a  < x < 9a 


The  properties  of  X are  presented  as  shown  in  the  following 


theorem: 
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Theorem  4.1: 

If  X £ C , then  X £ C . 

Proof: 

a)  f(x)  » f(-x)  Vx  since  f(x)  =•  f(-x)  Vx  . 

b)  f(x)  is  unimodal  with  maximum  at  0 since  f (x)  is 
unimodal  with  maximum  at  0. 

c)  [-0a,+9a]  is  finite  and  is  the  range  of  X . 

d)  f(x)  is  continuous  since  f (x)  is  continuous. 


Example  2:  Concentration  of  Mass 

The  new  random  variable  X will  have  range  [-6a,+6a] 
and  the  following  density  f and  distribution  function  F 


f(x) 


The  properties  of  X are  preserved  as  is  shown  in  Theorem  4.2. 


Theorem  4.2: 


If  X e C , X e C 


dx  = 9dv 
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Var  (X) 


f (v)0dv 


+a 

.2  C 2 


f (v)dv 


9 Var  (X)  . 


2.  The  Parametric  Models: 


9 is  now  the  parameter  for  this  sensitivity  analysis  with 
each  random  variable  having  its  parameter  9_.  j = 1,  n . 

The  conservative  approximation  will  be  presented  here. 


Model  I: 


^For  e^eC  j = 1,  n and  y >_  yj  . 


minimize  c x 


subject  to 


? V:  ibi  + <2h  - » l iAijiajej 


i ■ 1,  . . . , m 


Using  a more  convenient  notation  the  model  can  be  described  as: 


minimize  c x 


subject  to  Ax  >_  b + B'9 


where  B'  is  an  n * m matrix  such  that  B^  * “ ^Aij^aj 
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This  is  a multiparametric  right-hand  side  linear  program 
and  such  problems  have  been  discussed  in  D.  Walters  [14].  However, 
any  dimensional  parametric  problem  can  be  discussed  by  using  the 
relation  9 = A + B9'  , in  particular  if  one  sets  0^  = 6 Vj  , 
then  it  is  reduced  to  a one-dimensional  parametric  problem. 


Model  II: 


^For  a^eC  j = 1,  . . . , n and  y i J and  (x  j x >_  0}  C 


...  T 

minimize  c x 

subject  to  x e Q 


j=l 


[Ay 


+ (1  - 


2V 


a. 8 . ]x. 
J J J 


b. 

i 


i = 1. 


m . 


This  is  a parametric  column  linear  program  and  we  will  refer 
the  reader  to  Lawrence  [9]. 

The  deterministic  equivalents  for  Models  I and  II  are  not  in 
form  amenable  for  this  type  of  sensitivity  analysis;  this  is  why 
the  approximations  are  used  here.  We  will  mention  again  that  these 
approximation  problems  are  identical  to  the  original  problems  for 
y = 1 and  y - y and  that  these  are  good  approximations  in  the 
neighborhood  of  y = 1 , as  a variation  9 is  felt  most  strongly 
at  Y 3 1 as  shown  in  Figure  4.1. 


I 
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E.  The  Reducing  of  Uncertainty  Problem 

One  problem  of  further  interest  is  the  problem  of  the  trade-off 
of  the  improvement  of  the  optimal  value  of  the  objective  function 
when  the  uncertainty  is  increased  versus  the  cost  incurred  by  this 
increased  uncertainty.  For  example,  in  Section  C,  if  there  exists 
a cost  function  associated  with  the  vector  y > the  problem  become 
that  of  selecting  optimal  decisions  x and  standards  y . The 
same  problem  exists  in  Section  D where  y is  fixed;  the  variations 
in  the  ranges  of  the  random  variables  can  have  a cost  associated 
with  them.  The  problem  is  optimizing  the  total  cost  of  the  original 
function  and  the  cost  of  reducing  the  uncertainty  of  the  random 
variables.  This  is  why  we  will  call  this  problem  "the  reducing  of 
uncertainty  problem." 

1.  Cost  Functions: 

The  cost  functions  for  the  reduction  of  9 or  y that  we  are 
going  to  consider  have  the  following  characteristics:  They  are  non- 
negative and  increasing  for  decreasing  values  of  S or  y . 
Essentially,  the  cost  of  reducing  the  uncertainties  (reducing  the 
range  [-a^.+a^]  to  [-Sa^Sa^]  with  0 < 0 < 1)  goes  up  as  the 
range  decreases.  For  y , the  cost  due  to  producing  material  not 
meeting  standards  or  not  meeting  the  demand,  for  example,  increases 
as  the  probability  y is  decreased. 

We  will  propose  the  following  cost  functions.  We  will  use  the 
symbol  5 to  represent  both  the  vector  8 and  y (y  = 2y  - 1 
as  defined  in  2.  of  Section  C)  to  avoid  repeating  the  discussion. 
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a)  In  the  case  where  all  reductions  5^  i * 1,  n are 

equal  to  5 , a reasonable  cost  function  is: 


with  dg  >_  0 . Then 


c(l)  = 0 

lim  [c  (<5)  ] = +®  . 
o-*0 


This  is  nonnegative  and  increasing  for  decreasing  values 
of  d (0  < 6 < 1)  . 

b)  In  the  case  a)  above  it  might  be  unrealistic  to  postulate 
that  all  uncertainty  can  only  be  removed  at  an  infinite 
cost.  This  is  especially  true  for  <5  = y . Recall  that 
y = 2y  - 1 in  the  parametric  problem  where  y is  the 
parameter.  We  can  see  that  if  the  cost  is  infinite  for 
y = 0 , this  corresponds  to  infinite  cost  for  y = j , 
which  is  the  cost  of  each  constraint  to  be  satisfied  ^ 
of  the  time.  It  is  clear  that  a modification  to  a)  is 
needed  to  reflect  this  fact,  this  is  why  we  introduce  b) : 
If  5i  =*  5 Vn 

c(5)  3 d~+T  “ d~+T  where  dl  ” 0 ; d0  - ° 


then  c(l)  = 0 ; c(0) 


d 


0 


d1(d1  + 1) 


< +00  . 
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c)  When  all  y^  are  not  necessarily  equal,  the  generalization, 


for  <5  = (5, 6 ) , is : 

l n 


c(6) 


l 


j-1  d^  + 5. 
1 J 


I 


j-1  <4  + 1 


with  >_  0 and  d3  >_  0 for  all  j-1,  . . . , n . 

d)  A more  global  approach  where  the  total  uncertainty  reduced 

is  taken  into  consideration  is  for  5 = (6, , ...,  6 ) : 

1 n 


c(o)  = 


l Vj  + d0  l di 

j-1  3 3 j-0  3 


with  d.  >0  Vj  = 0,  ...»  n . 
J ~ 


It  is  important  to  note  that  for  6.  = 0 , we  are  talking 

about  reducing  uncertainty  when  we  reduce  6 . It  is  in  this 

context  that  the  name  "the  reducing  of  uncertainty  problem"  was 

devised.  However,  when  <5^  = Yj  = 2y^  - 1 , a decrease  in  6 

corresponds  to  a decrease  in  y . which  is  an  increase  in  the 

i 

probability  of  the  solution  not  being  feasible  and  the  cost  function 
then  reflects  the  cost  associated  with  this  expected  loss  of 
feasibility. 

Many  more  cost  functions  could  be  proposed;  however,  we  will 
restrict  our  attention  to  d)  which  is  a generalization  of  a)  and  b) . 
This  is  because  this  cost  function  has  the  advantage  of  being 
convex  as  will  be  shown  in  the  following  theorem.  It  is  also 
amenable  to  a solution  scheme  presented  in  Chapter  V. 


r 


Theorem  4.4: 


For  dj>.0  J * 0,1,  ....  n and  y >_  0 the  function 


do  + dTy 


Proof : 


is  convex. 


Consider  any  vector  x and  y such  that  x >_  0 and  y >_  0 


Then: 


Case  1: 


If 


dTx  >_  dTy  >_  0 
dn  + dl'x  1 dn  + dTy  i 0 


.T  .T 
d x - d y 


,T  jT 

> ' X " T \2  - ° 


(d0  + dTx)  (dQ  + dTy)  (dQ  + dTxj 


Case  2: 


If 


T T 
d y >_  d x >_  0 


0 > 


,T 

d x - d y 


,T  ,T 
d x - d v 


(do  + dTxHdo  + dIy)  “ (d0  + A): 


From  Case  1 and  2 it  follows  that 
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T T 

1 1 > dx  - d v 

do  + dTy  do  + dT*  ~ (d0  + dT*)2 

— 1 1 - y dJ(yi  ~ V 

‘o  + dIy  do  + “Tx  (do  + dTx)2 


— - ■ - 1 7“  + 7 

i0  + d y dQ  + d x dQ  + dTx 


[y  - x] 


Therefore 


is  a convex  function.  I 


d0  + d x 


2.  Applications  to  Model  I: 


For  y and  e^  e C j = 1,  n we  have  the  following 

conservative  approximations. 


a)  For  6 = y . 

The  model  can  be  formulated  as  follows  using  the  notation 
of  1)  of  Section  3. 


T 1 1 

minimize  c x + - 

d„  + dTY  ? 

0 L dA 

j-0  J 

subject  to  Ax  - By  >_  b 

1 > Y > 0 . 


b)  For  5=9. 

Here  also  using  the  notation  2)  of  Section  D the  model  is 
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T 1 

minimize  c x + 


d0  + d 0 


n 

l <*« 


j=0 


subject  to  Ax  - B'0  >_  b 

1 >_  9 >_  0 . 

These  two  problems  a)  and  b)  fall  into  the  general  pattern 
of  the  following  problem: 


...  T 1 

minimize  c x + 


, , ,T  n 

do  + d * l i. 


1-0 


subject  to  Ax  - By  >_  b 

1 L y L 0 


with  d >_  0 . 

This  problem  is  analyzed  in  Chapter  V and  an  algorithm  is 
presented  to  solve  it. 

These  conservative  approximations  do  not  yield  the  exact 
solution.  However,  these  problems  are  exact  for  y * 1 or  , 
and  for  b)  the  approximation  is  very  close  for  y near  1 as  the 
variable  9 reflects  the  change  in  the  ranges  of  the  random  variables 
and  this  variation  is  felt  most  strongly  in  the  neighborhood  of 
Y ■ 1 as  mentioned  earlier  (see  Figure  4.1). 


Applications  to  Model  II: 


For  y i j and  a j z ^ J 
conservative  approximations. 


1. 


n we  have  the  following 
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a)  For  5 = y 


minimize  c^x  + - 


dn  + dTY  V j 

0 1 di 

j-0  J 


subject  to 
n 

y (A..  - Y|A..|a.]x.  > b.  i = 1,  m 

1J  ij  j j — l 


x >_  0 

1 > Y i 0 . 


b)  For  6=6 


T 1 

minimize  c x + 


dn  ■*"  V 

o l d, 

j = l 2 


subject  to 

I [Ay  + [l  - JirJlAylyjlitj  ib,  i - 1,  . 


• • . m 


x >_  0 

1 >_  9 >_  0 . 

These  two  problems  are  nonlinear  programs  that  can  be  solved 
using  the  known  algorithm  and  no  special  solution  schemes  will  be 
presented . 
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CHAPTER  V 


In  this  chapter  the  following  programming  problem  is  analyzed 
and  an  algorithm  is  specified  for  its  solution. 

A.  The  Reducing  of  Uncertainty  Problem 

Find  the  optimal  solution  (x,y)  which  solves 


T 1 

minimize  c x + 


dQ  + d y 


subject  to  Ax  - By  >_  b 
x >_  0 
1 > y > 0 


with  d >_  0 and  d^  >_  0 . 

This  is  a convex  program  as  the  feasibility  set  is  a polyhedral 
set  and  therefore  convex,  and  its  objective  function  is  convex  as 


the  sum  of  two  convex  functions  since  c x is  linear  and 


an  T d y 


is  convex  as  shown  in  Theorem  4.4. 

This  problem  is  clearly  defined  if  the  following  condition  holds: 

Condition  5.1: 

There  exists  (x,y)  such  that 

Ax  - By  >_  b 
x > 0 
1 > y > 0 


T- 

and  dn  + d y > 0 
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We  will  assume  this  condition  is  satisfied  throughout  this 
discussion. 

The  strategy  used  to  solve  this  problem  will  consist  of  solving 
a different  equivalent  program  and  obtaining  the  original  optimal 
solution  from  the  optimal  solution  of  the  second  program.  The  term 
equivalent  program  is  used  as  defined  below. 

Definition: 

Two  programs  are  equivalent  if  there  exists  a scheme  to  obtain 
the  optimal  solution  of  any  one  of  the  two  problems  knowing  the  optimal 
solution  of  the  other  problem. 

B.  Two  Equivalent  Convex  Programs 
Theorem  5.2: 

The  following  two  programs  are  equivalent: 

(a)  minimize  h(x) 

xeft 

where  h(x)  =*  f(x)  + g(x)  , f (x)  and  g(x)  are  convex  functions 
for  x c ft  , and  ft  is  a convex  set. 

(b)  minimize  $(ct) 

ae  6 

where 

$(c0  = a + min  {g(x)  | f (x)  <_  3} 
xeft 

and 
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0 ■ (a  | {x  | x e il  and  f(x)  <_  a}  # 0}  . 

In  other  words,  using  the  definition  of  equivalent  programs, 
the  following  statements  are  true: 

(i)  min  h(x)  = min  $(a)  . 
xen  ae9 

(ii)  For  any  a optimal  solution  of  (b)  there  exists  at 
least  one  corresponding  x optimal  solution  of  (a) , 
which  can  be  obtained  as  follows:  x z ft  such  that 

, i 

min  { g (x)  | f(x)  <_  a}  = g(x)  . 
xeP. 

(iii)  For  any  x optimal  solution  of  (a)  there  exists  at 
least  one  corresponding  a optimal  solution  of  (b) , 
which  can  be  obtained  as  follows:  a such  that 
a » f (x)  and  a e 9 . 

Proof: 

Let  us  first  establish  two  facts  to  be  used  later  in  the  proof: 

For  any  x such  that  x z fl  and  h(x)  = min  h(x)  then: 

xcft 


Fact  1: 


g (x)  * min  { g (x)  | f(x)  <_  f (x) } . 
xefl 


Fact  2: 


^ (f  (x) ) <_  min  4 (a)  . 
oe9 


II  X 
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If  Fact  1 were  not  true  then  there  would  exist  an  x such  that 
e 0 and  g(x)  < g(x)  and  f (x)  <_  f (x)  which  yields:  x e Ji 

such  that  h(x)  = f(x)  + g(x)  < f (x)  + g(x)  «*  h(x)  . 

This  contradicts  our  assumption  about  x . 

Therefore  Fact  1 is  true. 

If  Fact  2 were  not  true  then  there  would  exist  an  a such  that 
a £ 9 and  4>(a)  < <t>(f(x))  as  <Kai)  = a + min  (g(x)  | f (x)  <_  a} 

X£ft 

• * "k 

and  a £ 9 . There  exists  an  x such  that  x s 12  and 

g(x  ) = min  { g (x)  | f(x)  <_  a}  . 

Xoft 

■k  k 

Therefore,  there  exists  x e fi  such  that  h(x  ) = 
f(x  ) + g(x  ) £ a + g(x  ) = 4> (a)  . 

Hence 

h(x*)  < (f  (x) ) . 

However,  Fact  1 established  that 

$(f(x))  = f(x)  + min  {g(x)  | f (x)  <_  f (x) } = f (x)  + g(x) 
xeft 

* 

so  there  exists  x e ft  such  that 

h(x  ) < f(x)  + g(x)  = h(x) 

which  contradicts  the  assumption  about  x , therefore,  Fact  2 is 


true. 


i 
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Now  we  can  prove: 

(I)  min  h(x)  = min  $(<*)  • 
xeft  ae9 

As  Fact  2 say  that 

$(f  (x))  i.  min  $(a)  . 

0t£@ 

It  is  sufficient  to  show  that: 

1)  f (x)  c 9 . 

This  is  true  since 

x £ {x  | x £ ft  and  f (x)  <_  f (x) } 
and  therefore  {x  | x £ ft  and  f (x)  <_  f (x) } / 0 . 

2)  h(x)  = $(f(x))  . 

Fact  1 establishes  this  as: 

$(f(x))  - f(x)  + min  (g(x)  | f(x)  <_f(x)} 
xefi 

=*  f(x)  + g (x) 

= h(x)  . 

Hence  as  f(x)  e 9 and  by  Fact  2 

4> ( f (x))  = min  b(a) 

Ct£9 


and  since 
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T 


*(f(x))  - h(x) 


and 


h(x)  ■ min  h(x)  . 
xeil 


It  is  true  that 


min  h(x)  = min  4>(a)  • 
xeQ  ae0 


(ii)  Va  t 0 such  that 


$(<*)  =*  min  4>(a)  . 
ct£0 


There  exists  x £ ft  such  that 


g(x)  = min  {g(x)  | f (x)  £ a} 
X£fl 


and 


h(x)  = f(x)  + g(x)  = min  h(x)  . 

xeft 


Let  x £ 7l  be  such  that  g(x)  = rain  Cg(x)  | f (x)  <_  a} 

xeft 


an  x exists  since  a £ 0 , then 


f(x)  = a and  h(x)  = $(<*) 


because  if  it  were  not  true  then  f (x)  < a and 


such 


h(x)  = f(x)  + g(x)  < t(a) 


which  yields  the  contradiction  that  there  exists  x e II  such  that 


h(x)  < min  4>(a)  • min  h(x) 
aed  xeCl 


as  seen  in  (i).  Therefore 


> (ex)  = a + g(x)  = f(x)  + g(x)  = h(x) 


Hence  h(x)  = min  Ma)  = min  h(x)  as  seen  in  (i) . 
cie9  xef< 


(iii)  Vx  such  that  x e ft  and  h(x)  = min  h(x) 

xeH 

exists  a e 9 such  that  a = f (x)  and 


* (a)  = min  $(a)  • 
as0 


Let  a e 9 such  that  a = f(x)  ; such  a exists 
{x  | x e JJ  and  f (x)  <_  f (x) } ^ 0 since  x belongs  to 
We  have  seen  in  (i)  and  (ii)  that 

h(x)  = min  4>(a) 
aed 

and 

h(x)  - <> (f  (x) ) . 


Hence 


$(f(x))  = min  $(a) 
ct£0 


and  a * f(x)  is  an  optimal  solution  of  (b) . ■ 


, then  there 


since 
that  set. 
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Program  (b)  is  also  a convex  program  as  is  seen  in  the  next 
two  lemmas. 

Lemma  5.3: 

The  set  9 * {a  | (x  | x e 8 and  f(x)  < a}  ^ 9}  is  a convex 

set. 

Proof : 

12  12 
Va  e 9 and  a e 9 . There  exist  x e 12  and  x z £ 

such  that 


fCx1)  <_  a1  and  f(x2)  <_  a2  . 

Hence  for  any  A such  that  0 <_  A <_  1 it  is  true  that: 

Af (x1)  + (1  - A)f(x2)  < Aa1  + (1  - A)a2  . 

However  using  the  convexity  of  f(x)  it  is  also  true  that: 

fCAx1  + (1  - A)x2)  <_  Af(x^)  + (1  - A)f(x2)  <_  Aa1  + (1  - A)a“  . 

This  inequality  and  the  fact  that  £2  is  a convex  set  clearly 
1 2 

shows  that  for  any  a e 9 , a e6,0<_A<_1  there  exists  an 

12  12 
x e ft  , namely  Ax  + (1  - A)x  , such  that  f(x)  <_  Aa  + (1  - A)a 

1 2 

Therefore  Aa  + (1  - A)a  e 9 and  9 is  a convex  set.B 

Lemma  5.4: 


The  function  <f>(a) 


is  convex  for  a c 9 . 


Proof : 


Va^  e 9 , a2  £ 9 . 


ipCa1)  = + min  {g(x)  | f(x)  < o'1"} 


<j>(a2)  = a2  + min  (g(x)  ) f(x)  < a2} 


12  12 
As  a £0  and  a £ 6 there  exists  x £ SI  and  x £ ft 


such  that 


<{>(a^)  = a^  + g(x^)  with  f(x^)  <_  a^  . 
4>(a^)  = a2  + g(x2)  with  f(x2)  <_  a2  . 


1 2 

For  any  X such  that  0 <_  X <_  1 , Xu  + (1  - X)a  £ 9 
by  Lemma  5.3,  therefore  there  exists: 


$(Xa^  + (1  - X)a2)  = Xa^"  + (1  - X)a2 
+ min  {g(x)  | f(x)  < Xa1  + (1  - X)a2}  . 


Now  if  we  want  to  prove  that  $(a)  is  a convex  function  for 
a £ 9 it  is  sufficient  to  show  that 


MX*1  + (1  - X)a2)  < X$ (a1)  + (1  - X)$(a2) 


Since  f is  a convex  function  and  ft  a convex  set 


Xx1  + (1  - X)x2  £ ft 


fax1  + (1  - A)x2)  < XfCx1)  + (1  - A)f(x2)  < Xa1  + (1  - A)ct2  . 


Therefore: 

min  {g(x)  | f (x)  <_  Xa1  + (1  - A)a2}  <_  gCXx1  + (1  - X)x“)  . 

Hence 

•KXa1  + (1  - A)a2)  <_  Xa1  + (1  - X)a2  + gUx1  + (1  - X)x2)  . 

Using  now  Che  convexity  of  g(x)  it  is  true  that: 

<{) (Xa1  + (1  - X)a2)  <_  Xa1  + (1  - X)a2  + XgCx1)  + (1  - X)g(x2) 

«>  4> (Xa1  + (1  - A)a2)  <_  Afa1  + g(x1)]  + (1  - X)  [a2  + g(x2)] 

■*=*  ^ ( Xa 1 + (1  - A)a2)  <_  X4> (ct1)  + (1  - X)4> (a2) 

^»(a)  is  convex  for  a a 0 . ■ 

C.  An  Equivalent  Convex  Program  to  the  Reducing  of  Uncertainty  Problem 

If  we  apply  the  results  of  Section  B to  our  original  problem 
we  obtain  the  following  facts: 

Theorem  5.5: 


The  following  two  problems  are  equivalent. 


T 1 

(a)  minimize  c x + 


d0  + d y 


subject  to  Ax  - By  >_  b 
x > 0 


1 > y > 0 


(b)  minimize  <j>(a) 
subject  to  a e 9 
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where 


<j>(a)  = a + min 


I. 


T « ) 

c x < a> 


) T 1 ^ 

(x,y)eQ  (d0  + d y ) 

a = { (x,y)  | Ax  - By  >_  b , x >_  0 , 1 >_  y >_  0} 
9 =•  {a  | { (x,y)  | (x,y)  e Q and  cTx  <_  ci}  ^ b) 


Proof : 

Apply  Theorem  5.2  to  the  convex  program  (a) . ■ 

Since  it  is  our  goal  to  use  problem  (b)  to  solve  problem  (a) 
it  is  useful  to  study  (b)  further. 

Proposition  5.6: 

Under  condition  5.1: 

\ 1.  i T I -1 

min  — | c x <.  <*/  - 7 x I T 

(x,y)eQ  ( d + dy  ) min  ^-dQ  - d y ] c x < a 

u (x,y)efl 


Proof : 

Since  dQ  >_  0 and  d >_  0 and  x >_  0 , y >_  0 
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rain  j — zr* 

(x,y)sft  ( d + dy 


T I 
c x < a 


(x,y)eft 


{d0  + dTy  I cTx  < a} 


-min  {-dp.  - dTy  j cTx  <_  u> 

(x.y)eQ  ( U ’ 


( T 

min  < -d  - d y 

(x.y)efl  * 


Corollarv  5.7: 


*<a)  ' “ + 


where 


i|i(a)  = -min  {-d  - dTy  | c^ 

(x,y)e£l  1 


x <_  a | 


Proof : 


Apply  Proposition  5.6. 


Prooosition  5.8: 


<p (a)  is  a bounded  function  for  a e 9 . T d . >_  ip(a)  >_  0 


Proof : 


Since  d 0 and  d >_  0 and  as  (x,y)  e Q 1 > y > 0 


n n 

<_  d.  + dy  <_  l d =*  + l d >_  p(,a)  >_  0 . 1 
u j=0  3 j-0  3 


Prooosition  5.9: 


(i)  If  for  a Ma)  * £ d.  . Then  Va  subject  to  a >_  a 


i|i(a)  * l d . 


77 


(ii)  If  for  a ’-p(ct)  = 0 . Then  Va  subject  to  a <_  a 


ijj(a)  * 0 or  i^(a)  is  infeasible. 


Proof : 


Since  ip(ct)  - - min  <-d  - d^y 

(x,y)eQ  1 U 


T | T 
y c x 


(i)  If  iKa)  = T d . =s>  for  c^x  < a the  minimum  bound  - J d. 

j-0  J j-0  J 

T 

has  been  reached  and  relaxing  the  constraint  c x <_  a will 

not  improve  the  objective  function. 

T 

(ii)  Same  reasoning  as  -d  - d y reaches  its  upper  bound; 
however,  ip  (a ) can  be  infeasible  for  a < a . 


Corollarv  5.10: 


If  for  a <P(ct)  = £ d.  . Then  <p( a)  is  an  increasing  linear 

j-0  J 

■ c - C. ~ if  \ . 1 


function  of  a for  a > a : <t>(a)  = a + 


Proof : 


d>  (at ) = a + 


n 

l dj 

j-0  J 


ip  (a) 


Proposition  5.9(i)  shows  that  for  a >_  a '('(a)  * £ d . , therefore 

1 j=0  2 

for  a > a <p(a)  - a + . ■ 

— n 

l dj 

j-0  J 


Proposition  5.11: 


The  set  0 is  either  the  empty  set  or  the  whole  real  line  or  an 
interval  closed  on  the  left  and  having  +®  as  a boundary  on  the  right. 
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Proof : 

Lemma  5.3  established  that  9 is  a convex  set  and  as  it  is 

one-dimensional,  9 is  an  interval  of  the  real  line.  If  the 

constraint  set  ft  is  empty,  0 is  empty  as  there  does  not  exist 

T 

any  (x,y)  such  that  (x,y)  t ft  and  c x <_  a for  any  a . 

If  the  problem  is  unbounded,  Corollary  5.7  tells  us  that 


<j>(a) 


1 

i|/(aO 


and  Proposition  5.3 


a + 


1 


d. 

3 


< (Jl(Ci)  . 


So  that  4>(a)  is  unbounded  if  and  only  if  9 = (-»,+«)  . 
The  upper  bound  of  the  interval  is  always  +°°  as  for  any 
ct  e 9 . Then  for  any  a >_  a , a e 9 since 

0 = {a  | {(x,y)  | (x,y)  e ft  and  cTx  <_  a}  / 0} 

if  there  exists  (x,y)  e ft  such  that  c^x  a , then  surely 

T-  - 

c x < a for  a > a . 


If  there  exists  a * b such  that 


79 


then  b is  the  left  hand  bound  of  the  interval  and  the  interval 
is  closed  because  the  set 

X 

{(x,y)  | (x,y)  z Q and  cx  <_  a} 

is  a closed  set.  ■ 

D.  General  Description  of  the  Algorithm  and  Optimality  Criterions 

As  we  have  mentioned,  the  idea  for  solving  the  original  problem 
is  to  first  convert  it  into  an  equivalent  convex  program,  solve 
this  problem,  then  retrieve  the  optimal  solution.  The  algorithm 
is  concerned  with  solving  the  second  problem.  It  will  be  done 
in  two  phases. 

Phase  1: 

A sequence  {a^}  is  generated  z 9)  such  that  > ai 

from  a starting  feasible  point  a z 9 . (Incidentally  i can  be 

o 

negative  as  the  starting  point  is  not  necessarily  at  the  boundary 
of  the  set  9 .)  This  sequence  is  generated  until  an  interval 

or  [a^  is  identified  where  the  optimal  solution 

lies.  This  is  done  simply  by  evaluating  the  q(a^)'s  and  comparing 
them  until  the  following  optimality  criterion  1 is  satisfied. 

This  criterion  is  to  be  used  when  the  possibility  of  an  unbounded 
problem  has  been  discarded. 
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Optimality  Criterion  1: 

(i)  If  for  a , a'  , a"  e 9 such  that  a'  < a < a1' 
it  is  true  that 

ip  (a)  < P(a')  and  <i>  (a)  < ♦(a")  . 

Then  the  optimal  solution  lies  in  the  interval  [o', a'']  . 

(ii)  If  for  a'  , a1'  e 9 such  that  a'  < a"  it  is  true  that 

P(ct')  = Met")  . 

Then  Va  e [o', a"]  , a is  an  optimal  solution. 

(iii)  If  for  a'  , a"  e 9 such  that  a'  < a"  it  is  true  that 

Met')  < Ma")  2nd  Va  e 9 , a >_a'  , then  the  optimal 
solution  lies  in  the  interval  [a',a"]  . 

Proof : 

As  Mo)  is  a convex  function  and  9 is  an  interval  as  shown  in 
Lemma  5.4  and  Proposition  5.11;  Case  (i)  is  derived  from  the  fact 

that  Ma)  is  unimodal.  Case  (ii)  is  true  because  a convex  function 

can  be  constant  only  at  its  minimum.  Case  (iii)  is  when  a'  is 
the  left-hand  boundary  of  the  interval  9 ; then  as  p(a ) is  convex, 
either  a'  is  the  optimum  or  the  optimum  is  in  Che  interval 
[o', a"]  .■ 


Phase  2: 

Once  such  an  interval  has  been  identified,  a minimum  is  found  for 
the  range  and  this  is  the  global  minimum. 
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Optimality  Criterion  2: 

If  for  a such  that  a z [a'.ct'']  where  [o', a'']  is  the 
interval  obtained  from  Phase  1,  it  is  true  that 

$(a)  <_  <j)(a)  Va  e [a'  ,a"  ] , 

then  a is  the  optimal  solution. 

Proof : 

Since  <b(a)  is  convex  over  the  interval  9 and  [a'.a''] 
was  found  to  contain  the  optimal  solution,  this  optimality  criterion 
is  just  stating  that  a local  minimum  is  a global  minimum.® 

E.  Feasibility  and  Unboundness 

In  this  algorithm  an  initial  problem  is  used  to  obtain  a 
starting  feasible  point  or  to  determine  whether  the  original  problem 
is  unbounded  or  is  infeasible. 

Initial  Problem: 

T T 

minimize  c x - d y - dg 

subject  to  Ax  - By  >_  b 
x >_  0 

1 > y > 0 . 

Theorem  5.12: 

If  the  initial  problem  is  infeasible,  the  original  problem  is 


infeasible. 
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Proof: 

Both  problems  have  the  same  feasibility  set.® 

Theorem  5.13: 

If  the  initial  problem  is  unbounded,  then  the  original  problem 
is  unbounded . 

Proof : 

If  the  initial  problem  is  unbounded,  then  there  exists  a vector 
- - ~ 1 ~ 2 

(u,w,z  ,z  ) such  that 

- - — T 

0 f (u , w, z ,z”)  >_  0 

and 

Au  - Bw  - Iz1  ■ 0 
Iw  + Iz2  * 0 

and 

T-  T- 
c u - d w < 0 . 

~ 

It  is  obvious  that  w = z “0  since  that  is  the  unique 

- ~2  - ~2 
solution  of  l(w+z)=0  w>_0,z  2.0. 

Hence,  we  have  the  vector  (u,0,z\o)  such  that 

0 * (u, 0,^,0)  > 0 

and 


Bv  Condition  5.1  there  exists  (x,y)  such  that  Ax  - By  >_  b 


Then,  the  vector 


(Xu  + x,y)  is  a feasible  solution  and  makes  the  original  problem 


unbounded  by  increasing  X to  infinity  (X  >_  0) 


Theorem  5.14 


such  that 


mm 

(x,y  )e£J 
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Proof : 

s a 'pa  *p — 

If  there  existed  (x,y)  e ft  such  that  c x £ c x and 

t=  x_  X-  T=  T-  T- 

-d  y - d^  < -d  y - dg  then  cx-dy-d^cx-dy-d^ 

a a 

for  (x,y)  e ft  which  contradicts  our  assumption.* 

Corollary  5.15: 

Under  the  assumption  of  Theorem  5.14  the  following  is  true: 

'■K<*0)  = dTy  + dQ 

where  a » c^x  . 
o 

Proof : 

Use  the  definition  of  ’>(a)  . ■ 

F.  The  Parametric  Linear  Program  jj(a) 

We  have  already  introduced  ip  (a)  noting  that  <j>(a  > ‘ “ + 

Phase  1: 

As  <{<(a)  is  a parametric  linear  program  the  sequence  {cO 
used  for  Phase  1 of  the  algorithm  will  come  naturally  from  the 
values  of  ct  where  the  parametric  linear  program  changes  basis. 

T 

4>( a)  = -minimize  -d^  - d y 

subject  to  Ax  - By  >_  o 
x >_  0 
1 > y > 0 
T „ 

c x < a . 
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The  initial  problem  gives  us  a starting  feasible  point  <xq 
with  the  feasible  solution  for  as  seen  in  Corollary  5.15. 

The  idea  is  then  to  first  increase  a until  the  optimality  criterion 
1 is  satisfied  or,  if  necessary,  decrease  a . 


Phase  2: 

In  Phase  2 we  will  use  the  fact  that  the  points  of  the  sequence 
{a^}  are  the  points  where  the  basis  changes  in  the  parametric  l.p. 
'Ha)  . 

From  the  theory  of  linear  programming  it  is  well  known  that 

for  points  of  the  sequence  {ct^}  : 

For  a . < a < a . , , 
l — — l+l 


,Ka)  . ^“m1  ~ *(ai)  a + - V<ai+l> 


“i+l  ~ “i 


“i+l  “ “i 


and  for  a,  , < a < a. 

i-1  — — i 


<Ma) 


,'K«i)  - ’K°li_1)  “i^i-i^  “ cti-i'l,'(ai^ 

= a + 


ai  “ Vi 


“i  - ai-l 


We  can  now  prove  the  following  two  theorems  under  the  following 
assumptions:  a^_]_  • » ai+l  are  ^ consecutive  points  of  the 

sequence  generated  from  the  parametric  linear  program  '^(a)  which 
satisfied  the  optimality  criterion  1. 
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Theorem  5.16: 

t(ai)  < 4>(c*i+1)  > 


$(<*)  • 


(ii)  If  ^(a.+1)  " > 0 then  one  of  the  following  is 

true. 

(a)  a*  e [a.  and  <{> (ot*)  = min  <K=0 

1 1+1 

irk  **  / n 

(b)  a e [a., a.  . ] and  <j>(a  ) = min  $(a) 

1 1 

(c)  a*  £ tai»ai+i^  and  a $ ^ai,ai+l^  and 
$ (aj. ) ” min  $(<*) 

a£[ai’ai+l] 

* ** 

where  ct  , a are  defined  to  be: 


For  an  interval  [ai,ai+1 ] such  that 

(i)  If  <|)(ai+1)  - ❖(a.)  1 0 then 

^(a^)  = min 

ae[oi*ai+i] 


* 

a 


** 

a 


“i^i+l5 


i+1 


ai*(oi+l) 


i+1 


Proof ; 


For  the  interval 
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<j)(a) 


a + 


1 

i>  (a) 


where 


Ha) 


«Kc.+1)  - Ha^  ^ + “i+i*<ai>  - Qti^(cti+1) 


ai+l  " “i 


ai+l  ' “i 


The  derivative  for  Ha)  in  this  interval  is 


Ha)  = 1 - (iKa))[iKa)]'2  . 


The  roots  of  the  derivative  are  the  solution  to  the  equation: 


['Ha)  J2  = (Ha)) 


or 


>(ai+l)  - »(at)  - a.Ha.+1) 


ai+l  “ ai 


ai+l  ~ “i 


Ha^)  - ’HO 

Ct  — Ct 

i+l  i 


*<fiW  _ 'Mcti}  ai+iHct±)  - V^i+i) 
a + — 


“i+l  ’ “i 


“i+l  “ “i 


V 


^(ai+l)  “ Ha  ) 

a - a . 
i+l  l 


which  yields  the  two  roots 


ai+i  ■ ai  y 


a.,,  - a. 
i+l  i 


'Ha i+i)  - Hc^) 


** 


ai»(lW  - Vi^V  / Vi  - *1  ~ 

- *(al) 


(i)  If  ^(a^^)  " i|>(a^)  < 0 , no  root  exists  for  the  derivative 
and  $(a)  is  monotone  increasing  for  a e since 


< =(>(ai+1) 


i(i(a^)  = min  <?  (ct)  . 
ae[ai,ai+1] 


If  ^<ai+1)  = then 


ip(o)  = 4/(0  = for  a e 

and  <j>(a)  = a + is  an  increasing  linear  function  and 


4>(a.)  = min  4>(a)  • 

“^Wl1 


* ** 

(ii)  In  (a)  and  (b) , a and  a are  local  minimums  and  as 
$(a)  is  a convex  function  for  a e tai,ai+i^  we  have: 


For  (a):  ) = min  <j> (cx ) . 

ae[ai’ai+l] 


For  (b):  <j>  (cx  ) 


min  $(a)  . 

aetVai+i] 


* ** 

Note  that  both  a and  a cannot  belong  to  the  interval 
at  the  same  time  as  $(a)  is  convex  and  does  not  allow 
two  local  minimums. 
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?if 

(c)  If  neither  a or  a e Cai>ai+1J  then  $(°)  is 
monotone  increasing  in  the  interval  since  4>  (oc ) is 
convex  and  < <t>(a^+^)  • Therefore 


<t>  (cti> 


min  $(a)  . 


a£tai’ai+l] 


Theorem  5.17: 


For  an  interval  [a^^.a  ] such  that  4> (ct^)  K 


(i)  If  ip(ct^)  - < 0 then 


<^>  (a . ) = min  tj>(a) 

<*®[<*i_l»ai] 


(ii)  If  i(/(ai)  - > 0 then  one  of  the  following 

is  true: 


£ ^ 

(a)  a e [a.  .,a.]  and  4>(a  ) = min  $(<*) 

1 a£fcti_l*ai^ 

**  pi  / 'k’k 

(b)  a e [a.  , ,a  J and  <K<*  ) =*  min  <t>(a) 

(c)  a £ and  a £ [ai_1>ail  and 


<K<0 


min  <}>  (ot) 


ae*°i-l,ai^ 


where: 


* 

a 


** 

a 


a.^Ca.)  - ai'^cti-1)  f~~a j - aj-i~ 
ai  ‘ ai-l  \*(oi)  • ^“i-l5 

ai-l’j,(ai)  ' V^i-^  J ai  ~ Vi~ 

a.  - a^  " \*(0i)  - *(a1-]L) 
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Proof : 

In  a similar  fashion  to  the  proof  of  Theorem  5.16,  it  is 
easy  to  show  that  the  roots  of  the  derivatives  of  <t>(cO  for  the 

•fa  ji( 

interval  [ou  are  the  a and  a mentioned  in  the 

Theorem  5.16. 

(i)  If  ij)(a  ) - ij»(ai  p <0  no  root  of  the  derivative 
exists  and  <*>(a)  is  monotone  decreasing  in  the 
interval  since  $(<*)  is  convex  and 
so 

$(<*.)  = min  . 

c‘e[ai_l»ai] 

(ii)  The  same  reasoning  as  for  (ii)  of  Theorem  5.16  applies  here. 
Note,  however,  that  the  case  does  not 

arise,  since  then 

^(ai)  = ai  + 

and 

' “i-i  + 

which  contradicts  a,  ^ < a,  and  > 
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G.  The  Algorithm  for  Finding  the  Optimal  cc 
Let  us  restate  the  original  prob’em: 

T 1 

minimize  c x + — 

d0  + d ? 

subject  to  Ax  - By  >_  b 
x >_  0 
1 > y > 0 

.. 

with  d >_  0 and  dQ  >_  0 and  the  condition  that  3(x,y)  feasible 

T-  * I 

such  that  Qq  + d y > 0 . 

Step  1: 

Find  a starting  point. 

1.0; 

Solve  the  initial  problem: 

T T 

minimize  c x - d y - d^ 

subject  to  Ax  - By  >_  b 
x >_  0 

1 > y > 0 • 

This  is  a linear  program  and  can  be  solved  using  the  usual 
algorithm. 

1.1: 

If  the  problem  is  infeasible  STOP.  The  original  problem  is 


infeasible  (Theorem  5.12). 
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1.2: 

If  this  problem  is  unbounded  STOP.  The  original  problem  is 
unbounded  (Theorem  5.13). 

1.3: 

Otherwise  call  the  optimal  solution  (x,y)  set  c^x  ■ a . 

GO  TO  STEP  2. 

Step  2: 

2.0: 

Consider  the  problem: 

T 

ijj(a)  ■ -minimize  -d  y - d^ 

subject  to  Ax  - By  >_  b 
x _>  0 
1 > y > 0 

T ^ 
c x a 

and  ♦(<*)  * a + . 

>ii(a  ) has  for  optimal  solution  (x,y)  the  optimal  solution 
o 

of  the  initial  problem  (Corollary  5.14). 

i|)(aQ)  has  to  be  presented  in  a form  ready  for  parametric 
analysis  (Note  1 at  the  end  of  this  section  shows  how  the  transition 
from  Step  1 to  Step  2 can  be  done  easily) . 

L 
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2.0.0; 

n 

If  ijj(a  ) = y d.  , ip(a)  has  reached  its  upper  bound  and 

° j-0  J 

by  Corollary  5.10;  the  function 

4)(ct)  =*  a + 

J-0  J 

is  increasing  linearly,  so  the  search  has  to  be  done  for  a < ; 

hence  set  i : = 0 . GO  TO  2.2. 

2.0.1: 

If  ip(a.  ) > 0 , set  i : = 0 . GO  TO  2.1. 
o 

2.0.2: 

If  il)(a  ) = 0 , <t(a  ) is  not  defined,  we  need  to  increase  a 
o o 

until  ’p(a)  > 0 is  found,  such  an  a exists  by  Condition  1. 

Set  i : = 0 . 


2.0. 3: 

Find  the  next  point  where  the  basis  changes  in  the 

parametric  linear  program  4<(a)  by  increasing  a from  . 

2.0. 4: 

If  = 0 , set  i : * i + 1 . GO  TO  2.0.3. 

2.0. 5: 

If  Cct ^ > ® ’ set  ‘K0^)  51  +<”  • Set  d : * i + 1 • GO  TO  2.1. 
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The  algorithm  resumes  with  a new  feasible  point  for  which 
<}> (ot)  is  defined. 

2.1: 

Find  the  next  point  where  the  basis  changes  in  the 

parametric  linear  program  U; (ct ) by  increasing  ct  from  . 


2.1.0: 

n 

If  ^(a  ) ■ £ d . , an  upper  bound  for  ^ (at)  has  been 

j-0  J 

reached  (Corollary  5.10)  and  $(a)  is  increasing  linearly  beyond 


i+1  ' 


(a)  If  ^(a^)  > d> » the  optimal  interval  is 
GO  TO  STEP  3.2  (optimality  criterion  1 (i)). 

(b)  If  $(0^)  < 4>(ai+1)  » G0  TO  STEP  2.1.2,  the  optimality 
criterion  1 is  not  satisfied. 


2.1.1: 

If  <j>(a^+^)  < » set  i:=i  + l.  GO  TO  2.1. 

Optimality  criterion  1 is  not  satisfied. 


2.1.2: 


If  > $0=^) 


Case  l:  i 


GO  TO  2.2.  Only  two  points  have  been  investigated;  the  other 


ctQ  needs  to  be  investigated. 


side  of 
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Case  2:  i t 0 

The  optimal  solution  is  in  the  interval  ’ 

GO  TO  STEP  3.  C (i)  of  optimality  criterion  1). 

2.1.3: 

If  <t>(oti+l)  = <f(0li)  ST°P‘  ° £ [ai,ai+l]  iS  Sn  °ptimal 
solution  ( ( ii)  of  optimality  criterion  1). 


2.2: 

Find  a , the  next  point  for  which  the  basis  changes  in 
i-1 

the  parametric  linear  program  <Ka)  when  a is  decreased  from  . 

If  -^(a)  becomes  infeasible  for  a < , the  optimal  solution 

is  in  the  range  . GO  TO  STEP  3.2.  ((iii)  of  optimality 

criterion  1) . 

2.2.0: 

If  1)  =*  0 , 'J'(ai_1)  has  reached  its  lower  bound 

(Proposition  5.8).  Set  = "*"°°  ' 

2.2.1: 

If  4>(oi_1)  < 4>(ai)  .set  i : =•  i - 1 • GO  TO  2.2. 

2.2.2: 

If  $(a.  „)  > $(a.)  » the  optimal  solution  is  in  the  interval 
i-1  i 

[a.  L,a.]  . GO  TO  STEP  3.  ( (i)  of  optimality  criterion  1). 
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2.2.3: 

If  iKa^^)  “ $(ct^)  STOP.  Va  e ^ai-l,ai^  a is  an  °Ptima^ 
solution.  ((ii)  of  optimality  criterion  1). 

Step  3: 

Finding  the  optimal  a once  an  interval  has  been  identified. 

3.1: 

Interval  [ct^  • 


3.1.1: 


If  ip  (a.)  - ill  (a.  ,)  < 0 the  solution  is  either  a.  or  in 
i i-1  l 

the  range  ♦ GO  TO  3.2.  (Theorem  5.17  (i)). 


3.1.2: 


If  - >Hci;L_1)  > 0 


<a)  Compute  ~t  - 


* ★ 
If  a e [a^  ^,a^]  STOP.  The  optimal  solution  is  a 

(Theorem  5.17  (ii)a). 


(b)  Compute  a 


** 


«,-!»<».)  - ylyi)  I °t  - »!■! 

“t  - Vi  TKoi)  ' 


**  kk 

If  a £ [a^  ^.a^]  STOP.  The  optimal  solution  is  a 
(Theorem  5.17  (ii)b) . 


(c)  The  optimal  solution  is  either  or  in  the  interval 

^“i’C'i+l*  ' G0  10  3,2  (Theorem  5.17  (ii)c). 

3.2: 

Interval  [c^.a.^]  . 

3.2,1: 

If  <(>(<s^_^)  ~ 'f'(a^)  £ 0 STOP.  The  optimal  solution  is  ct . , 
by  Theorem  5.16  (i)  since  the  other  interval  has  already  been 
investigated . 


3.2.2: 


If  “ v(oi)  > 0 


(Theorem  5.16  (ii)a) . 


(b)  Compute  a 


** 


ai»(ai+l)  - a^Ca.)  I «i+1  - *■ 

“i+l  - ai  V(ai+1)  - *<°l 


1 ct 

’ a 

- i+1 

X 

rvi>  - 

• ,Kai) 

* 

solution 

is  a 

Ct  . , 

- a . 

. i+1 

l 

** 


If  a e ^ai,Cti+l^  STOP.  The  optimal  solution  is  a 
(Theorem  5.16  (ii)b) . 

(c)  STOP.  The  optimal  solution  is  by  Theorem  5.16  (ii)c 

since  the  other  interval  has  been  investigated. 
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Note  1: 

The  transition  from  Step  1 to  Step  2 in  the  previous  algorithm 
can  be  easily  made  by  doing  the  following: 

1.  Modify  the  initial  problem  by  adding  the  constraint 
T 

c x m where  m is  chosen  large  enough  as  not  to  affect 

the  outcome  of  the  problem,  (i.e.,  if  at  optimality 
T- 

c x = m , then  the  initial  problem  is  unbounded) . 

Initial  Problem: 

T T 

minimize  c x - d y - d^ 
subject  to  Ax  - By  >_  b 

y 1 1 

T 

c x <_  m 

x >_  0 y >_  0 . 

We  will  denote  this  linear  program  in  standard  form  as: 

T 

minimize  u z 

subject  to  Mz  = t 
z >_  0 . 

At  optimality  the  current  tableau  is  denoted: 

-T 

minimize  u z 

subject  to  Mz  = t 
z > 0 


with  optimal  solution  z = (x,y,w)  . 


For  Step  2,  modify  this  Optimal  tableau  in  the  following  way 

- T -T 

a)  Add  u'  to  the  current  objective  function  u where: 


u 


,T 


<U;)TS 


where  s is  the  optimal  basis  and 


u'  = (-c  ,0)  . 


b)  Add  t'  to  the  current  right-hand  side  t where: 


t ' = M ^ t ' and  t ' 
s 


-m  + a 


Mg^  is  the  basic  inverse  with  respect  to  the  basis  s 


-m  + in  t'  corresponds  to  the  constraint  c x <_  m 


3.  The  new  tableau  thus  obtained  should  be  either  optimal 

and  ready  for  parametric  analysis  or  a few  more  iterations 
might  be  needed  to  achieve  that  state. 


fl.  Finding  the  Optimal  Solution  to  the  Original  Problem  from 
the  Optimal  a 

Once  an  optimal  a has  been  identified,  Theorem  5.1  applied  to 
our  problem,  cells  us  chat  an  optimal  (x,y)  can  be  found  by  solving 


the  problem. 
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minimize 


do  + dTy 


subject  to  Ax  - By  >_  b 
x >_  0 
1 > y > 0 


c x < a . 


However,  Proposition  5.6  tells  us  that  (x,y)  is  also  the 
optimal  solution  of  the  problem: 


’P(ol')  = 


-minimize  -d^  - d y 


subject  to  Ax  - By  >_  b 


x > 0 


1 > y > 0 


T - 
c x < a 


Since  we  have  information  about  the  problem  i|>(a)  we  can  use 
it  to  find  (x,y)  . 


1*  If  a = a^  , a^  e {a^}  , the  sequence  generated  in  the 

_ _ k k 

algorithm,  then  (x,y)  = (x  ,y  ) . The  optimal  solution 

of  !j>(a,  ) is  readily  available. 

A 

2.  If  a < a < a and  a e {a, } , a,  e {a.}  , then: 


(x»y)  k * (xk,yk)  k + (a  - ak)M~k 
s s s* 
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and  (x,y)G  - 0 


k k. 


is  the  optimal  basic  sequence  for  ^(a^)  5 (x  ,y  ) is 

the  optimal  solution  of  '»  M ^ is  the  basic  inverse  at 

s 

optimality  of  i|/(a,  ) and  G is  the  set  of  indices  of  the  non- 


basic  variables.  The  one  in  the  vector 


corresponds  to  the 


T 

constraint  c x <_  a . 

This  is  just  an  application  of  parametric  linear  programming 
where  a is  the  parameter. 


I.  Convergence  Property  of  the  Algorithm 

We  will  need  the  following  propositions  to  establish  the  con- 
vergence of  the  algorithm. 

Proposition  5.18: 

If  the  linear  program  Ma)  is  nondegenerate,  then  the  sequence 
generated  in  the  algorithm  is  finite. 

Proof: 

{a^}  is  the  sequence  of  real  numbers  for  which  the  basis 
changes  in  the  parametric  linear  program  i^(o)  . There  is  a one  to  one 
correspondence  between  the  sequence  {a^}  and  sequence  of  basic 
sequences  of  the  problem  '!> (a)  . This  sequence  (of  basic  sequences) 
is  finite  since  there  is  a finite  number  of  such  sequences  and  none 
is  repeated,  because  under  nondegeneracy  the  objective  function  is 
improved  at  each  iteration.  Therefore,  the  sequence  {a^}  is  finite.® 
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Proposition  5.19: 

Under  degeneracy  of  '^(a)  , the  sequence  {aO  is  finite. 

Proof ; 

In  this  case,  a lexicographical  scheme  or  another  appropriate 
rule  of  pivoting  has  to  be  used  in  solving  the  parametric  linear 
program  ^(a)  to  insure  that  none  of  the  basic  sequences  is  repeated 
as  is  mentioned  in  the  proof  of  Proposition  5.18.® 

We  can  now  prove  the  finiteness  of  the  algorithm. 

Theorem  5.20: 

The  algorithm  terminates  in  a finite  number  of  steps. 

Proof : 

The  initial  problem  terminates  in  a finite  number  of  steps 
since  it  is  a linear  program  and  the  simplex  method  terminates  in 
a finite  number  of  steps  (degeneracy  is  taking  care  of  with  a 
lexicographical  scheme) . The  algorithm  then  proceeds  to  generate 
the  sequence  from  a second  linear  program  and  Propositions 

5.18  and  5.19  tell  us  that  this  sequence  is  finite.  Once  an  interval 
is  identified  from  this  sequence  in  Phase  2,  a small  finite  number 
of  3teps  is  necessary  to  obtain  the  optimal  solution.® 

We  have  just  seen  that  the  algorithm  terminates  in  a finite 
number  of  steps,  however  how  many  steps  are  needed  to  obtain  the 
optimal  solution  is  also  of  interest.  An  upper  bound  to  this  number 
of  steps  could  be  calculated,  but  as  in  the  simplex  method,  would 
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not  be  Indicative  of  the  real  amount  of  work  needed  for  the 
algorithm.  The  best  way  to  get  a feel  for  this  amount  is  to 
compare  it  to  the  simplex  method.  Essentially,  the  Initial  problem 
represents  one  whole  linear  programming  problem,  then  it  is  modified, 
and  parametric  analysis  is  performed.  We  can  confidently  say  that 
the  amount  of  work  is  of  the  order  of  the  solving  one  linear 
program  and  performing  parametric  analysis  on  the  right-hand  side. 
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CHAPTER  VI 

In  this  chapter  the  models  I and  II  are  generalized  to  become 
joint-chance  constrained  programming  problems.  Some  approximations 
are  presented  using  the  concept  of  associativity  of  random  variables 
and  the  results  of  Chapter  II. 

A.  Generalized  Models  I and  II 


We  would  like  to  set  more  general  constraints  on  the  feasibility 
sets  of  Models  I and  II.  For  example,  we  could  add  the  constraint 
that  the  probability  of  the  solution  being  feasible  be  greater  than 
a certain  specified  number.  This  is  why  we  introduced  joint 
probability  constraints;  joint  probability  constraints  are  found 
in  the  literature  in  [1]  and  [10];  we  will  use  these  in  the  following 
generalized  models  I and  II. 


Generalized  Model  I: 


( n ) 
{ I c, (x,  + e.) 


Prob  n 
| its 


minimize  E ' J 

b-i 

subject  to  x e ft 

Prob  < 7 A..(x.  + e.)  > b.>  > y.  i * 1,  ...»  m 

(j-I  ^ J j - ij  - ri 

I X + V k-”  + 1 1 


where  s is  the  set  of  indices  of  the  rows  of  A s “ {1,  ...,  m}  , 

and  s,  are  subsets  of  s for  k=m+l,  ....  t . 
k 

il  is  a polyhedral  set  defined  by  a set  of  linear  constraints. 
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Generalized  Model  II: 


minimize  E < £ c (1  + a.)x  > 

(j-l  J J 3) 

subject  to  x e 0 

( n ) 

Prob  I l (1  + oij  )Xj  >.  bi|  >_  i - 1,  . . . , m 

Prob  [ O ( l A (1  + a )x  > b )|  >.  y.  k-m  + 1,  t. 

(iEsk(j-l  2 2 )) 


s , and  Q are  defined  as  in  Model  I. 

The  generalized  models  I and  II  fall  in  the  category  of  chance- 
constrained  programming  with  joint  constraints.  However,  the  constraints 
are  not  statistically  independent  since  the  e^  and  are  involved 

in  all  the  constraints.  Therefore,  these  problems  cannot  be  treated 
as  described  in  [1]  and  [10].  We  will  draw  upon  the  theory  of 
associated  random  variables  developed  by  Esary-Proschan  and  Walkup  [6] 
to  determine  conservative  approximations  to  these  problems. 


B.  Associated  Random  Variables 


Definition: 


Random  variables  X^  j » 1,  ...»  n are  associated  if 


Cov  (T(X),A(X))  > 0 


for  all  pairs  of  increasing  binary  functions  T , A where 

X * (X. , ....  X)  . 
i n 
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We  will  now  use  the  previous  three  theorems  to  prove  theorems 
relevant  to  our  models.  We  will  first  define  the  following  set 
of  matrices. 

Definition: 

— 

Let  M be  the  set  of  matrices  for  which  all  the  elements  in 
any  column  have  the  same  sign. 

We  can  now  present  the  following  results. 


Theorem  6.4: 


If  j ■ 1,  ...,  n are  independent  random  variables  and  A 

is  an  m x n matrix  belonging  to  M , then  the  random  variables 


T A. .X.  i * 1,  ...,  m are  associated. 
L ij  J 


J-l 


Proof : 

Call  T the  set  of  indices  of  the  column  of  A:  T = {1,  ....  n} 
and  s the  set  of  indices  of  the  rows  of  A : s ■ {1,  . . . , m}  . 
Consider  the  following  sets 


T'  - {j  1 

Au 

1 o 

for 

all  its} 

T"  - (j  | 

Aij 

1 0 

for 

all  i e s}  . 

As  A £ M : T'  U T" 

= T 

Now  consider  the  set  of  independent  random  variables  U 
comprised  of  for  j e T'  and  -X^  for  j e T''  . 
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By  Theorems  6.1  and  6.2  the  random  variables  £ |A^|(-Xj)  + 


jeT' 


£ | A | X . i = 1,  ....  m are  associated  since  U is  a set 

jeT"  2 

of  independent  random  variables  therefore  associated  by  Theorem  6.2, 
n 

and  £ | A . j | X..  is  an  increasing  function  of  X^  which  makes 


3-1 


3 


these  random  variables  associated  by  Theorem  6.1.  However,  for 

i 3 1 » . I |A  | (-X  ) + l I A | X « l A X 

jeT'  2 jeT"  12  2 j-1  2 

by  definition  of  T'  and  T"  .■ 


Theorem  6.5: 


If  Xj  j = 1,  ....  n are  associated  random  variables  and  A 
is  a nonnegative  m * n matrix  then  the  random  variables 


n 


) A. .X.  i ■ 1,  ...,  m are  associated. 


1 


Proof : 


As  A >_  0 , for  i * 1,  ...,  m , £ A.,x.  are  increasing 

j-1  2 

n 

functions  of  x ; then  by  Theorem  6.1  for  i = 1,  ...,  m , T A. .X. 

-S  ij  l 
j*l  J 

are  associated  random  variables.! 


C.  Conservative  Approximations  for  the  Generalized  Models  I and  II 

Using  the  results  of  Section  B,  we  shall  first  present  the 
following  approximations. 

Theorem  6.6: 


In  Model  I,  if  either  (i)  or  (ii)  below  holds 
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(i)  e^  j ■ 1,  n are  associated  random  variables 

and  A >_  0 for  k = m + 1,  t (where  A 

Sk  Sk 

is  the  matrix  consisting  of  the  rows  i of  A such 
that  i e s^) . 

(ii)  e^.  j = 1 n are  independent  random  variables 

and  A e M for  k * m + 1,  t . 

Sk 

Then,  if  x satisfies: 


then  x satisfies: 


Prob  | D Ii  A.  . (x.  + e. ) > b. ) 1 > y,  k»»  + l,  ....  t. 
13  1 1 ~ ~ k 


Proof : 

n 

(i)  Theorem  6.5  tells  us  that  for  i e s.  £ A .e.  are 

* J-l  13  3 

associated  random  variables.  Applying  Theorem  6.3  we  have: 


Prob 


Prob 


n 

l 


Aij®j  - 2 I 


Hence  if 


x is  such  that: 


Prob 


n 

l 

J-1 


AUej  ~bi 
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then 


'"‘  A iii  Vi  + £ Vi-bi|  Uv 


(ii)  Theorem  6.4  tells  us  that  for  i e s,  , T A..e.  are 

k . , 11  i 

1*1  J 

associated  random  variables,  from  now  on  the  reasoning 
is  the  same  as  in  (i).B 


Theorem  6.7: 


In  Model  II  if  either  (i)  or  (ii)  below  holds: 


(i)  Oj  j = 1,  ....  n are  associated  random  variables  and 

A >0  for  k = m + 1,  ....  t . 

Sk  " 

(ii)  a j = 1,  ....  n are  independent  random  variables  and 

A c M for  k = m + 1 , ...,  t . 

Sk 


Then  if  x satisfies: 


3 

ies. 


1 - 


( n n y 

Prob  7 A , x ,ot  < b.  - 7 A, .x.  • 

b-i  y)i  - 1 j-i  13  3), 


- Yk 


k = m + 1,  ...»  t 


x satisfies 


Prob 


I I 2 

llt\  h:‘ 


A, . (1  + J,)x.  > b 


ii 


J'  J ~ i 


k - m + 1,  . . . , c 


Ill 


Proof • 


where  / A \ = |A  ) x 

\ sdij  \ sklij  3 

for  all  i and  j . Therefore,  by  Theorem  6.4  i e sk  , 


(i)  As  A > 0 , the  matrix  A £ M 
sk  “ sk 


T A r.a,  are  associated  random  variables. 
j-1  ij  j j 


Similarly  under  (ii),  as  A e M , A e M where 

sk  k 


(Kit  * (\)^ 


and  by  Theorem  6.4  for  i £ s^  % Aijxjaj 


are  associated  random  variables. 

Now  following  the  proof  of  Theorem  6.6,  by  Theorem  6.3  we  have 


Prob 


( ( n 

| n v'  y A..x.a.  > 
I tesk  (j-1  13  3 3 - 


> II  Prob  I y A x.a.  >_ 

- Us,.  3-1  11  : J 


Hence  if  x is  such  that: 


n — iW  VjjUb 


then: 


( ( n ) 

Prob  \ n < l A (1  + ct  )x  > b ( > 

(iMkU-l  )) 


-Yk 


We  shall  now  use  Theorem  6.6  and  6.7  to  present  complete 
formulations  of  the  conservative  approximations  for  Models  I and  II. 


r 
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1.  Model  I: 

Theorem  6.8: 

For  either  condition  (i)  or  (ii)  of  Theorem  6.6  the  following 
problem  is  a conservative  approximation  to  the  generalized  Model  I. 


T r 

minimize  c x + \ c E{e  } 

j-1  3 3 

subject  to  x c H 


Proof : 

This  model  is  valid  by  Theorem  6.6  and  the  deterministic 
equivalent  of  Model  I presented  in  Chapter  I.B 

2.  Model  II: 

Theorem  6.9: 

For  either  condition  (i)  or  (ii)  of  Theorem  6.7,  the  following 
problem  is  a conservative  approximation  to  the  generalized  Model  II. 
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minimize  J c . (1  + E (a . ) )x . 


j-1 

subject  to  x e SI 


j 


ies, 


i x' 


/ 

r & i 

(l  - G 

b . - V A ,x 

\ 1X 

_ j-1  ij 

n 

* Prob  • 

y a x.a , < 2 

j-i  ij  j ^ ~ 

J J 


j,  Aijxj  + iGx1(1  - V i ki  1 • 


• . m 


>_Y^  k = m + 1,  . . . , t 


Proof : 

This  is  the  deterministic  equivalent  presented  in  Chapter  I 
with  the  approximation  of  Theorem  6.7  applied  to  it.H 


D.  Conservative  Approximations  for  the  Generalized  Models  I and  II 
Using  the  Results  of  Chapter  II 

If  in  addition  to  the  conditions  outlined  in  the  previous  section, 
we  utilize  random  variables  e^  and  belonging  to  the  set  C 

defined  in  Chapter  II,  explicit  conservative  approximations  can  be 
identified . 


1.  Model  I: 

Theorem  6.10: 

If  for  e^  j = 1,  ...,  n e..  e C either  the  following  (i) 
or  (ii)  holds: 
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(i) 

(ii) 


j = 


A e M 
sk 


1,  n are  associated  random  variables  and 

for  k = m + 1 , t . 

1,  n are  independent  random  variables  and 

for  k=m+l,  ....  t . 


Then  for  y > | the  following  convex  program  is  a conservative 
approximation  to  the  generalized  Model  I. 


u 

'i-  l 

* i 


T 

minimize  c x 
subject  to  x e ft 
b. 


j"1  2 l | A.  . | a 

L I ij  I j 


Xj  “ 2 “ 


j=l 


n 

2 l IA 
j-1 


i * 1,  . . . , m 


ij,aj 


i **  1,  . . . , m 


l Ln(y^)  >_  Ln(v^)  k * m + 1 , . . . , t 


xes. 


where  the  [-a., a.]  j = 1,  n are  defined  to  be  the  finite 

ranges  of  e^  j *=  1,  ....  n . 


Proof: 


1)  As  e.  z C for  j = 1,  n the  objective  function  is 

T 

simply  c x . 

2)  As  shown  for  Model  I in  Theorem  3.1  the  first  set  of 
constraints  result  of  the  inequality  for  y >_  y 


u r— ID 
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Ji  ’ bi 


1 


2 l lAw  Ja. 


j=*l 


ij'  j 


If  we  call  the  right-hand  side  y then  it  is  obvious 


that  if  >_  y^  then 


I A x - bt 


j-1 


i Y, 


for  all  i » 1,  . . . , m . 

3)  Theorem  6.3  yields  the  first  approximation. 


( 

n 

) 

• • 

n 

Prob  \ O 
(i£Sk 

Vxj + V - bi 

V Gi 

) iesk 

> ■ y vj. 

However,  since  ejeC  j - 1,  n then  by  Corollary  2.10 

A. . e.  s C and  therefore  it  symmetric  and 
1 13  3 


n 

n 

1 - G. 

b . - 1 A .x 

- G. 

l A. .x.  - h 

1 

[ 1 j-1  13  jj 

1 

[j-1  13  3 iJ 

Using  again  the  same  inequality  as  in  part  2)  since  y _> 
we  obtain  that 


Prob  ' n 
I ies. 


l A (x  + e.)  ^b 


j-1 


lj'  j V - i 


J 


1 n y, 

ies, 

k 


r^>  1 1 — ■ 


Hence  for  k - m + 1,  ....  t Che  following  constraints  are 


conservative  approximations. 


11  yi  - Yk 


or  equivalently 


l Ln(yi)  1 Ln(yk)  as  yt  i Y1  i 0 it  s; 


which  makes  the  whole  program  convex  since  £ Ln(y  ) is  a 

i£Sk 

concave  function  of  y^ 


2.  Model  II: 


Theorem  6.11: 


If  for  a^  e C j ■ 1, 
{x  ! x > 0}  C n . 


. . , n either  (i)  or  (ii)  holds  and 


(i)  o j - 1, 


...  n are  associated  and  A >0  for 

Sk  " 


k = m + ly  . . . | t 


(ii)  a j - 1, 


. . , n are  independent  and  A e M for 

sk 


k ■ m + 1,  ...,  t . 


Then  for  y _>  y , the  following  nonlinear  program  is  a conserva 
tive  approximation  to  the  generalized  Model  II. 


minimize  c x 


jL  IAu  + Kj1*!1*: 


subject  to  x e (2 

“ wi  2 l 'AijiajXj 


1 = 1, 


h t'-'ia 
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21  y i ” 1 1 ...»  in 

n w >.  Yk  k-m+1,  ...,t. 

ies, 

k 


Proof : 


As  a e C for  j - 1, 


„ 1 


AljVi  ' C 


n by  Corollary  2.10 


Prob[ji Ali<l  + ibl 

[ jj.  Ai)V3  1 bl  ‘ X Vl]  1 Y‘  ' 


1 - Prob 


As  V A. .x.a.  e C 

j^i  1J  J J 


Prob 


Uvi^Xv3-bJ^ 


Applying  Theorem  2.13 


Prob 


n a 

1 l Aiixi~bi+  ^ |AiiiajXj 
n n J 1=1  iJ  3 1 i-l  J J 

l A x oi  < I A x - b > 1 n 

)-l  j«l  ] 2 £ 


since  for  y > J - I AijXj  - b±  > 0 and  Fj1(0)  --(A^ia.x. 
for  F(z)  » Prob  {A^x^  <_  z}  by  Theorem  2.7. 
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Therefore  if  for  x >_  0 


w. 

J 


X Vj  ~ bi  * 

2 X Kj'Vj 


Then  Prob  | l (1  + > bi|  > y±  . 


Prob 


Theorem  6.7  showed  that 


(a  lx  Aij(1+aj)Ijib| 


Therefore  if  for  x >_  0 


-,11  Pr°b  ll  Aij(1  + aj)X3i  -“i 


ies,  (j“l 


11  wi  - Yk 
i«k  3 


Then 


n Prob 
ies,. 


u 


lml  Aij(1  + aj)Xj  ^bi 


iYk 


and 


Prob  I O 
ies, 


^1Ali(1  + “j)l3  ibi 


1Y, 
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APPENDIX  NOTATION 


The  vectors  mentioned  in  the  text  (i.e.,  b , c , d)  are 
column  vectors;  superscript  T denotes  the  transpose  of  a vector: 


; b - (b.  , . . . , b ) . 
l n 


If  A is  an  n * m matrix  then: 


= the  element  in  the  i row,  j column  of  A 


j column  of  A 

. th  , . 

i row  of  A . 


X £ X 


x is  an  element  of  the  set  X 


there  exist  at  least  one  x 


X C Y 


set  X is  contained  in  the  set  Y 


X U Y 


the  union  of  the  sets  X and  Y 


X n Y 


intersection  of  the  sets  X and  Y 


end  of  proof 
absolute  value  of  x 


the  empty  set 


{x  | P}  the  set  of  x having  property  P 
{xi>  the  set  ^ * * * xi_X»xi»xi+l»  "** 


n 

l xi 

i-1 


X,  + X_  + • • • + X 

12  n 


X,X_  •••  X 

12  n 


1 


(a,b)  open  interval  from  a to  b 
[a,b]  closed  interval  from  a to  b 

[n]  reference  n in  bibliography 

/ (through  a symbol,  e.g.,  #)  negation 

if  and  only  if 
=*>  implies 

Ln(x)  natural  logarithm  of  x 

Prob  \E}  probability  of  the  event  E occurring 


E {X}  expectation  of  the  random  variable  X 

f * g convolution  of  the  densities  f and 


* f.  f,  * f f 
. , i 12  r 


the  inverse  of  the  function  F 


the  inverse  of  the  matrix  A . 


If  y is  a vector  the  statement 


Y = a means  Y = * 


Y 21  a means  y 2.  | 


1 0 

I * *•  the  identity  matrix 

.0  *1. 


the  gradient  of  the  function  f . 


